www.uspto.gov
`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and TrademarkOffice
`Address: COMMISSIONER FOR PATENTS
`P.O. Box 1450
`Alexandria, Virginia 22313-1450
`
`17/499,294
`
`10/12/2021
`
`Tadamasa TOMA
`
`2021-2109A
`
`4830
`
`Pp
`Lind&
`Wenderoth,
`Wenderoth, Lind & Ponack, L.L.P.
`1025 Connecticut Avenue, NW
`Suite 500
`Washington, DC 20036
`
`NGUYEN, KATHLEEN V
`
`2486
`
`PAPER NUMBER
`
`NOTIFICATION DATE
`
`DELIVERY MODE
`
`09/13/2023
`
`ELECTRONIC
`
`Please find below and/or attached an Office communication concerning this application or proceeding.
`
`Thetime period for reply, if any, is set in the attached communication.
`
`Notice of the Office communication was sent electronically on above-indicated "Notification Date" to the
`following e-mail address(es):
`eoa@ wenderoth.com
`kmiller@wenderoth.com
`
`PTOL-90A (Rev. 04/07)
`
`

`

`
`
`Disposition of Claims*
`1-5 is/are pending in the application.
`)
`Claim(s)
`5a) Of the above claim(s) ___ is/are withdrawn from consideration.
`Cj} Claim(s)
`is/are allowed.
`Claim(s) 1-5 is/are rejected.
`S)
`) © Claim(s)___is/are objected to.
`Cj) Claim(s
`are subjectto restriction and/or election requirement
`)
`S)
`* If any claims have been determined allowable, you maybeeligible to benefit from the Patent Prosecution Highway program at a
`participating intellectual property office for the corresponding application. For more information, please see
`http://Awww.uspto.gov/patents/init_events/pph/index.jsp or send an inquiry to PPHfeedback@uspto.gov.
`
`) )
`
`Application Papers
`10)( The specification is objected to by the Examiner.
`11) The drawing(s) filed on 10/12/2021 is/are: a)[¥) accepted or b)(. objected to by the Examiner.
`Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a).
`Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121 (d).
`
`Priority under 35 U.S.C. § 119
`12)1) Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d)or (f).
`Certified copies:
`_—_c)L) None ofthe:
`b)L) Some**
`a)Q) All
`1.2) Certified copies of the priority documents have been received.
`2.2 Certified copies of the priority documents have been received in Application No.
`3.4.) Copies of the certified copies of the priority documents have been receivedin this National Stage
`application from the International Bureau (PCT Rule 17.2(a)).
`* See the attached detailed Office action for a list of the certified copies not received.
`
`Attachment(s)
`
`1)
`
`Notice of References Cited (PTO-892)
`
`Information Disclosure Statement(s) (PTO/SB/08a and/or PTO/SB/08b)
`2)
`Paper No(s)/Mail Date
`U.S. Patent and Trademark Office
`
`3)
`
`(LJ Interview Summary (PTO-413)
`Paper No(s)/Mail Date
`4) (J Other:
`
`PTOL-326 (Rev. 11-13)
`
`Office Action Summary
`
`Part of Paper No./Mail Date 20230906
`
`Application No.
`Applicant(s)
`17/499,294
`TOMAetal.
`
`Office Action Summary Art Unit|AIA (FITF) StatusExaminer
`KATHLEEN V NGUYEN
`2486
`Yes
`
`
`
`-- The MAILING DATEof this communication appears on the cover sheet with the correspondence address --
`Period for Reply
`
`A SHORTENED STATUTORY PERIOD FOR REPLYIS SET TO EXPIRE 3 MONTHS FROM THE MAILING
`DATE OF THIS COMMUNICATION.
`Extensions of time may be available underthe provisions of 37 CFR 1.136(a). In no event, however, may a reply betimely filed after SIX (6) MONTHSfrom the mailing
`date of this communication.
`If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHSfrom the mailing date of this communication.
`-
`- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133).
`Any reply received by the Office later than three months after the mailing date of this communication, evenif timely filed, may reduce any earned patent term
`adjustment. See 37 CFR 1.704(b).
`
`Status
`
`1) Responsive to communication(s) filed on 10/12/2021.
`C} A declaration(s)/affidavit(s) under 37 CFR 1.130(b) was/werefiled on
`
`2a)() This action is FINAL. 2b)¥)This action is non-final.
`3)02 An election was madeby the applicant in responseto a restriction requirement set forth during the interview
`on
`; the restriction requirement and election have been incorporated into this action.
`4)\0) Since this application is in condition for allowance except for formal matters, prosecution as to the merits is
`closed in accordance with the practice under Exparte Quayle, 1935 C.D. 11, 453 O.G. 213.
`
`

`

`Application/Control Number: 17499,294
`Art Unit: 2486
`
`Page 2
`
`DETAILED ACTION
`
`The communication is in responseto the application filed 10/17/2021, wherein claims 1-5
`
`are pending and are examined as follow.
`
`Notice ofPre-AIA or AIA Status
`
`The presentapplication, filed on or after March 16, 2013, is being examined underthe
`
`first inventorto file provisions of the AIA.
`
`Information Disclosure Statement
`
`The information disclosure statement (IDS) submitted on 08/1 1/2022 and 10/21/2021.
`
`The submission is in compliance with the provisions of 37 CFR 1.97. Accordingly, the
`
`information disclosure statementis being considered by the examiner.
`
`Claim Rejections - 35 USC § 103
`
`In the eventthe determination ofthe status of the application as subject to AIA 35 U.S.C.
`
`102 and 103 (or as subject to pre-AJA 35 U.S.C. 102 and 103) is incorrect, any correction of the
`
`statutory basis (i.e., changing from AIA to pre-AIJA)for the rejection will not be considered a
`
`new groundof rejection if the prior art relied upon, and the rationale supporting the rejection,
`
`would be the same undereitherstatus.
`
`The followingis a quotation of 35 U.S.C. 103 which formsthe basis for all obviousness
`
`rejections set forth in this Office action:
`
`A patent for a claimed invention may not be obtained, notwithstanding that the claimed
`invention is not identically disclosed as set forth in section 102, if the differences
`betweenthe claimed invention and the priorart are such that the claimed invention as a
`
`

`

`Application/Control Number: 17499,294
`Art Unit: 2486
`
`Page 3
`
`whole would have been obviousbeforethe effective filing date of the claimed invention
`to a person having ordinary skill in the art to which the claimed invention pertains.
`Patentability shall not be negated by the mannerin which the invention was made.
`
`Thetext of those sections of Title 35, U.S. Code not includedin this action can be found
`in a prior Office action.
`The factual inquiries for establishing a backgroundfor determining obviousness under 35
`U.S.C. 103 are summarizedas follows:
`1. Determining the scope and contents of the priorart.
`2. Ascertaining the differences betweenthe prior art and the claimsat issue.
`3. Resolving the level of ordinary skill in the pertinentart.
`4. Considering objective evidence presentin the application indicating obviousness or
`nonobviousness.
`
`4,
`
`Claims 1-5 are rejected under AIA 35 U.S.C. 103 as being unpatentable over Deng
`
`etal. (U.S 2021/0297672) hereinafter Deng, in view of Zhao et al. (U.S 2017/0094314)
`
`hereinafter Zhao.
`
`Regarding claims 1 and 3, Deng discloses an encoderthat encodes an image (Deng
`
`[0303]: encoder), the encoder comprising: circuitry; and memory coupledto the circuitry (Deng
`
`[00521], [0630]: memory and processors), wherein the circuitry and an encoding method of
`
`encoding an image:
`
`derives a prediction residual indicating a difference between a current block anda
`
`prediction image of the current block (Deng [0539], [0550]: generate residual data whichis
`
`difference between current block and a predicted block);
`
`performsprimary transform on the prediction residual, and performs secondary transform
`
`on aresult of the primary transform; performs quantization on a result of the secondary
`
`transform; and encodes a result of the quantization (Deng [0303]: for encoder, primary
`
`transform is performedfirst, then followed by secondary transform and quantization, and
`
`CABAC bit encoding), and
`
`

`

`Application/Control Number: 17499,294
`Art Unit: 2486
`
`Page 4
`
`in the performing of the secondary transform, when a matrix weightedintra prediction
`
`includedin intra prediction and having a plurality of prediction modes is used, the matrix
`
`weighted intra prediction generating the prediction image by performing matrix calculation on a
`
`pixel sequence obtained from pixel values of surrounding pixels of the current block,the
`
`transform set for the secondary transform being applied to primary transform coefficients
`
`obtained from the result of the primary transform (Deng [0069], [0016], [0151]: Matrix-Based
`
`Intra Prediction using neighboring samples; [0330]: intra prediction modes; [0303]: for
`
`encoder, primary transform is performedfirst, then followed by secondary transform and
`
`quantization, and CABAC bit encoding. Hence, apply secondary transform to result of
`
`primary transform having coefficients as also in [0552]).
`
`Deng does not explicitly disclose when a matrix weighted intra prediction included in
`
`intra prediction and havingaplurality of prediction modes is used, the circuitry uses, as a
`
`transform set for the secondary transform, a commontransform set shared amongthe plurality of
`
`prediction modes.
`
`However, Zhao discloses when a matrix weighted intra prediction included in intra
`
`prediction and having a plurality of prediction modes is used, the circuitry uses, as a transform
`
`set for the secondary transform, a commontransform set shared amongthe plurality of prediction
`
`modes (ZhaoFig. 3, [0110]: apply secondary transform after a primary transform, and
`
`followed by quantization; [044]: first inverse transform and secondinverse transform;
`
`[0086 ]-[0093]: matrix calculation; [0130]-[0131]: for different intra modes, the same
`
`transform set maybe applied. Hence, a commontransform set shared among the prediction
`
`modes).
`
`

`

`Application/Control Number: 17499,294
`Art Unit: 2486
`
`Page 5
`
`It would have been obvious to a person of ordinary skill in the art before the effective
`
`filing date of the claimed invention to use the system,as disclosed by Deng, and further
`
`incorporate having when a matrix weighted intra prediction includedin intra prediction and
`
`having a plurality of prediction modes is used, the circuitry uses, as a transform set for the
`
`secondary transform, a common transform set shared amongtheplurality of prediction modes, as
`
`taught by Zhao, to improve transform efficiency (Zhao [0044]).
`
`Regarding claims 2 and 4, Dengdiscloses a decoderthat decodes an image, the decoder
`
`comprising: circuitry; and memory coupledto the circuitry (Deng [0303]: decoder; [00521],
`
`[0630]: memory and processors), wherein the circuitry anda decoding method of decoding an
`
`image:
`
`performsinverse quantization on a current block to be decoded; performs secondary
`
`inverse transform on a result of the inverse quantization, and performs primary inverse transform
`
`on aresult of the secondary inverse transform (Deng [0303]: for decoder, CABAC bit
`
`decoding and inverse quantization, then secondary inverse transform is performed, then
`
`followed by primaryinverse transform); and
`
`derives the image based on a prediction image of the current block and a prediction
`
`residual whichis a result of the primary inverse transform (Deng [0069], [0539], [0554]:
`
`residual is generated by inverse transform andis used reconstruct image), and in the
`
`performing of the secondary inverse transform, when a matrix weighted intra prediction included
`
`in intra prediction and having a plurality of prediction modesis used, the circuitry uses, the
`
`matrix weighted intra prediction generating the prediction image by performing matrix
`
`

`

`Application/Control Number: 17499,294
`Art Unit: 2486
`
`Page 6
`
`calculation on a pixel sequence obtained from pixel values of surrounding pixels of the current
`
`block, the inverse transform set for the secondary inverse transform being applied to quantized
`
`coefficients obtained from the result of the inverse quantization (Deng [0069], [0016], [0151]:
`
`Matrix-BasedIntra Prediction using neighboring samples; [0330]: intra prediction modes;
`
`[0303]: for decoder, CABACbit decoding and inverse quantization, then secondary inverse
`
`transform is performed, then followed by primary inverse transform).
`
`Deng does not explicitly disclose when a matrix weighted intra prediction included in
`
`intra prediction and havingthe plurality of prediction modes is used, a common inverse
`
`transform set shared amongtheplurality of prediction modes is used as an inverse transform set
`
`for the secondaryinverse transform
`
`However, Zhao discloses when a matrix weighted intra prediction included in intra
`
`prediction and havingthe plurality of prediction modesis used, acommon inverse transform set
`
`shared amongtheplurality of prediction modesis used as an inversetransform setfor the
`
`secondary inverse transform (Zhao Fig. 3, [0110]: apply secondary transform after a primary
`
`transform,and followed by quantization; [044]: first inverse transform and second inverse
`
`transform; [0086 ]-[0093]: matrix calculation; [0130]-[0131): for different intra modes, the
`
`sametransform set maybe applied. Hence, a commontransform set shared among the
`
`prediction modes).
`
`It would have been obvious to a person of ordinary skill in the art before the effective
`
`filing date of the claimed invention to use the system,as disclosed by Deng, and further
`
`incorporate having when a matrix weighted intra prediction includedin intra prediction and
`
`having a plurality of prediction modes is used, the circuitry uses, as a transform set for the
`
`

`

`Application/Control Number: 17499,294
`Art Unit: 2486
`
`Page 7
`
`secondary transform, a common transform set shared amongtheplurality of prediction modes, as
`
`taught by Zhao, to improve transform efficiency (Zhao [0044]).
`
`Regarding claim 5, Deng discloses a non-transitory computer readable mediumstoring a
`
`bitstream (Deng [00521], [0630]: memory and processors), the bitstream comprising:
`
`a parameter according to which a decoderselects a prediction mode from among a
`
`plurality of prediction modes (Deng [0115]: signaling index predmode; [0303]: decoder); and
`
`a picture including a current block on which a decodingprocessis performed (Deng
`
`[0148]: current picture and current block), wherein in the decoding process:
`
`inverse quantization is performed on the current block to be decoded: secondary inverse
`
`transform is performed on a result of the inverse quantization, and primary inverse transform is
`
`performed on a result of the secondary inverse transform (Deng [0303]: for decoder, CABAC
`
`bit decoding and inverse quantization, then secondary inverse transform is performed,
`
`then followed by primaryinverse transform); and
`
`an imageis derived based on a prediction image of the current block and a prediction
`
`residual whichis a result of the primary inverse transform (Deng [0069], [0539], [0554]:
`
`residualis generated by inverse transform andis used reconstruct image), in the performing
`
`of the secondary inverse transform, whenamatrix weighted intra prediction includedin intra
`
`prediction and havingthe plurality of prediction modesis used, the matrix weighted intra
`
`prediction generating the prediction image by performing matrix calculation on a pixel sequence
`
`obtained from pixel values of surrounding pixels of the current block, the inverse transform set
`
`for the secondaryinverse transform being applied to quantized coefficients obtained from the
`
`result of the inverse quantization (Deng [0069], [0016], [0151]: Matrix-Based Intra Prediction
`
`

`

`Application/Control Number: 17499,294
`Art Unit: 2486
`
`Page 8
`
`using neighboring samples; [0330]: intra prediction modes; [0303]: for decoder, CABAC
`
`bit decoding and inverse quantization, then secondary inverse transform is performed,
`
`then followed by primaryinverse transform).
`
`Deng does not explicitly disclose when a matrix weighted intra prediction included in
`
`intra prediction and havingthe plurality of prediction modes is used, a common inverse
`
`transform set shared amongtheplurality of prediction modes is used as an inverse transform set
`
`for the secondaryinverse transform
`
`However, Zhao discloses when a matrix weighted intra prediction included in intra
`
`prediction and havingthe plurality of prediction modesis used, a common inverse transform set
`
`shared amongtheplurality of prediction modesis used as an inversetransform setfor the
`
`secondary inverse transform (Zhao Fig. 3, [0110]: apply secondary transform after a primary
`
`transform,and followed by quantization; [044]: first inverse transform and second inverse
`
`transform; [0086 ]-[0093]: matrix calculation; [0130]-[0131): for different intra modes, the
`
`sametransform set maybe applied. Hence, a commontransform set shared among the
`
`prediction modes).
`
`It would have been obvious to a person of ordinary skill in the art before the effective
`
`filing date of the claimed invention to use the system,as disclosed by Deng, and further
`
`incorporate having when a matrix weighted intra prediction includedin intra prediction and
`
`having a plurality of prediction modes is used, the circuitry uses, as a transform set for the
`
`secondary transform, a common transform set shared amongtheplurality of prediction modes, as
`
`taught by Zhao, to improve transform efficiency (Zhao [0044]).
`
`

`

`Application/Control Number: 17499,294
`Art Unit: 2486
`
`Page 9
`
`Conclusion
`
`Any inquiry concerning this communication or earlier communications from the
`
`examiner should be directed to KATHLEEN V NGUYENwhosetelephone numberis (571)270-
`
`0626. The examiner can normally be reached on M-F9:00am-6:00pm.
`
`If attempts to reach the examinerby telephone are unsuccessful, the examiner’s
`
`supervisor, Jamie Atala can be reached on 571-272-7384. The fax phone numberfor the
`
`organization where this application or proceedingis assignedis 571-273-8300.
`
`Information regarding the status of an application may be obtained from the Patent
`
`Application Information Retrieval (PAIR) system. Status information for published applications
`
`may be obtained from either Private PAIR or Public PAIR. Status information for unpublished
`
`applications is available through Private PAIR only. For more information about the PAIR
`
`system,see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR
`
`system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would
`
`like assistance from a USPTO CustomerService Representative or access to the automated
`
`information system, call 800-786-9199 (IN USA OR CANADA)or 571-272-1000.
`
`/KATHLEEN V NGUYEN/
`Examiner, Art Unit 2486
`
`