www.uspto.gov
`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and TrademarkOffice
`Address; COMMISSIONER FOR PATENTS
`P.O. Box 1450
`Alexandria, Virginia 22313-1450
`
`16/875,553
`
`05/15/2020
`
`Chong Soon LIM
`
`735256.424
`
`1898
`
`Seed IP Law Group LLP/Panasonic (PIPCA)
`701 5th Avenue, Suite 5400
`Seattle, WA 98104
`
`HAQUE, MD NAZMUL
`
`ART UNIT
`
`2487
`
`PAPER NUMBER
`
`NOTIFICATION DATE
`
`DELIVERY MODE
`
`07/13/2021
`
`ELECTRONIC
`
`Please find below and/or attached an Office communication concerning this application or proceeding.
`
`The time period for reply, if any, is set in the attached communication.
`
`Notice of the Office communication was sent electronically on above-indicated "Notification Date" to the
`following e-mail address(es):
`USPTOeAction @ SeedIP.com
`
`pairlinkdktg @seedip.com
`
`PTOL-90A (Rev. 04/07)
`
`

`

`Office Action Summary
`
`Application No.
`16/875,553
`Examiner
`MD N HAQUE
`
`Applicant(s)
`LIM etal.
`Art Unit
`2487
`
`AIA (FITF) Status
`Yes
`
`-- The MAILING DATEofthis communication appears on the cover sheet with the correspondence address --
`Period for Reply
`
`A SHORTENED STATUTORY PERIOD FOR REPLYIS SET TO EXPIRE 3 MONTHS FROM THE MAILING
`DATE OF THIS COMMUNICATION.
`Extensions of time may be available underthe provisions of 37 CFR 1.136(a). In no event, however, may a reply betimely filed after SIX (6) MONTHSfrom the mailing
`date of this communication.
`If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHSfrom the mailing date of this communication.
`-
`- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133}.
`Any reply received by the Office later than three months after the mailing date of this communication, evenif timely filed, may reduce any earned patent term
`adjustment. See 37 CFR 1.704(b).
`
`Status
`
`
`
`1) Responsive to communication(s) filed on 04/19/2021.
`C} A declaration(s)/affidavit(s) under 37 CFR 1.130(b) was/werefiled on
`2a)¥) This action is FINAL.
`2b) (J This action is non-final.
`3)02 An election was madeby the applicant in responseto a restriction requirement set forth during the interview
`on
`; the restriction requirement and election have been incorporated into this action.
`4\0) Since this application is in condition for allowance except for formal matters, prosecution as to the merits is
`closed in accordance with the practice under Exparte Quayle, 1935 C.D. 11, 453 O.G. 213.
`
`Disposition of Claims*
`1-33 is/are pending in the application.
`)
`Claim(s)
`5a) Of the above claim(s) ___ is/are withdrawn from consideration.
`C] Claim(s)__ is/are allowed.
`Claim(s) 1-33 is/are rejected.
`(1 Claim(s)__is/are objectedto.
`C} Claim(s)
`are subjectto restriction and/or election requirement
`* If any claims have been determined allowable, you maybeeligible to benefit from the Patent Prosecution Highway program at a
`participating intellectual property office for the corresponding application. For more information, please see
`http://www.uspto.gov/patents/init_events/pph/index.jsp or send an inquiry to PPHfeedback@uspto.gov.
`
`) ) ) )
`
`Application Papers
`10)() The specification is objected to by the Examiner.
`11) The drawing(s) filed on 05/15/2020 is/are: a)[¥) accepted or b)(.) objected to by the Examiner.
`Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a).
`Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121 (d).
`
`Priority under 35 U.S.C. § 119
`12)Z) Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f).
`Certified copies:
`_—_c)L) None ofthe:
`b)L) Some**
`a)X) All
`1.2 Certified copies of the priority documents have been received.
`2.2) Certified copies of the priority documents have been received in Application No.
`3.2.) Copies of the certified copies of the priority documents have been receivedin this National Stage
`application from the International Bureau (PCT Rule 17.2(a)).
`* See the attached detailed Office action for a list of the certified copies not received.
`
`Attachment(s)
`
`1)
`
`Notice of References Cited (PTO-892)
`
`2) (J Information Disclosure Statement(s) (PTO/SB/08a and/or PTO/SB/08b)
`Paper No(s)/Mail Date
`U.S. Patent and Trademark Office
`
`3) (J Interview Summary (PTO-413)
`Paper No(s)/Mail Date
`(Qj Other:
`
`4)
`
`PTOL-326 (Rev. 11-13)
`
`Office Action Summary
`
`Part of Paper No./Mail Date 20210708
`
`

`

`Application/Control Number: 16/875,553
`Art Unit: 2487
`
`Page 2
`
`Notice of Pre-AlA or AIA Status
`
`1.
`
`The present application, filed on or after March 16, 2013, is being examined
`
`under the first inventor to file provisions of the AIA.
`
`Response to Amendment
`
`2.
`
`Applicant's argument, filed on April 19, 2021 has been entered and carefully
`
`considered. Claims 1-33 are pending.
`
`Responseto Arguments
`
`3.
`
`on page 4 applicant argues "applicant does not concede that Tsai reference
`
`(WO02020140876)is entitled to the claimed priority dates”. While the applicant's
`
`argumentpoints are understood, the examiner respectfully disagrees it is because
`
`examiner uses the provisional application 62/786,530 which hasprovisional date
`
`December 30, 2018. Therefore, Tsai reference (WO2020140876)is entitled to be a
`
`valid claimed priority dates.
`
`On pages 4-5 applicant argues “Chen does not appearto disclose in
`
`responseto a determination not to split the current luma VPDU into smaller blocks,
`
`predicting a block of chroma samples without using luma samples’. While the
`
`applicant's argument points are understood, the examiner respectfully disagrees it is
`
`because Chen teaches ([see in section: 3.3.2 Cross-componentlinear model
`
`prediction]- a cross-componentlinear model (CCLM) prediction modeis used in the
`
`VTM4, for which the chroma samples arc predicted based on the reconstructed luma
`
`

`

`Application/Control Number: 16/875,553
`Art Unit: 2487
`
`Page 3
`
`samples of the same CU byusing a linear model where predc(i,j) represents the
`
`predicted chroma samplesin a CU and recL(i,j) represents the downsampled
`
`reconstructed luma samples of the same CU; see also table 3-13 where luma sample
`
`not being used).
`
`Therefore, the rejection has been maintained.
`
`Claim Rejections - 35 USC § 103
`
`The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness
`
`rejections set forth in this Office action:
`
`A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is
`not identically disclosed as set forth in section 102, if the differences between the claimed invention
`and the prior art are such that the claimed invention as a whole would have been obvious before the
`effective filing date of the claimed invention to a person having ordinary skill in the art to which the
`claimed invention pertains. Patentability shall not be negated by the manner in which the invention
`was made.
`
`The factual inquiries for establishing a background for determining obviousness
`
`under 35 U.S.C. 103 are summarized asfollows:
`
`1. Determining the scope and contents of the prior art.
`
`2. Ascertaining the differences between the prior art and the claims at issue.
`
`3. Resolving the level of ordinary skill in the pertinent art.
`
`4. Considering objective evidence presentin the application indicating
`
`obviousness or nonobviousness.
`
`Claims 1-33 are rejected under 35 U.S.C. 103 as being unpatentable over Jianle
`
`Chen (Algorithm description for Versatile Video Coding and Test Model 4 (VTM 4);
`
`

`

`Application/Control Number: 16/875,553
`Art Unit: 2487
`
`Page 4
`
`given bythe applicant in the IDS); in view of TSAI, Chia-Ming ( WO 2020/140876;
`
`Priority Data: 30 December 2018);
`
`Regarding claim 1, Chen teaches an encoder‘([seein pg. 6, section: scope]-
`
`encoder), comprising: circuitry; and memory coupledto the circuitry([see in pg. 18]-
`
`memory); wherein the circuitry, in operation, performs the following: determining
`
`whether to split a current luma virtual pipeline decoding unit (VPDU) into smaller
`
`blocks([see in Fig. 6 amd 8]-spliting current luma into smaller block; [see also fig. 7 and
`
`section: 3.2.5]); in response to a determination not to split the current luma VPDU
`
`into smaller blocks([see in Fig. 7 and section: 3.2.4]-split is prohibited), predicting a
`
`block of chroma samples without using luma samples([see in section: 3.3.2 Cross-
`
`componentlinear model prediction]- a cross-componentlinear model (CCLM) prediction
`
`modeis used in the VTM4, for which the chroma samples arc predicted based on the
`
`reconstructed luma samples of the same CU byusing a linear model where predc(i,j)
`
`represents the predicted chroma samplesin a CU and recL(i,j) represents the
`
`downsampled reconstructed luma samples of the same CU); in response to a
`
`determination to split the luma VPDU into smaller blocks, predicting the block of
`
`chroma samples using luma samples([see in section: 3.3.2 Cross-componentlinear
`
`model prediction]- a cross-componentlinear model (CCLM) prediction modeis used in
`
`the VTM4, for which the chroma samples arc predicted based on the reconstructed
`
`luma samplesof the same CU byusing a linear model where predc(i,j) represents the
`
`predicted chroma samplesin a CU and recL(i,j) represents the downsampled
`
`reconstructed luma samples of the same CU Linear model parameter a and ~ arc
`
`

`

`Application/Control Number: 16/875,553
`Art Unit: 2487
`
`Page 5
`
`derived from the relation between luma values and chroma values from two samples,
`
`which are luma sample with minimum sample value and with maximum smamplc
`
`sample inside the set of downsamplcd neighboring luma samples, and their con-
`
`esponding chroma samples); and encoding the block using the predicted chroma
`
`samples([see in section: 3.3.2 Cross-componentlinear model prediction]- a cross-
`
`componentlinear model (CCLM) prediction modeis used in the VTM4, for which the
`
`chroma samples arc predicted based on the reconstructed luma samples of the same
`
`CU by using a linear model where predc(i,j) represents the predicted chroma samplesin
`
`a CU and recL(i,j) represents the downsampled reconstructed luma samples of the
`
`same CU Linear model parameter a and ~ arc derived from the relation between luma
`
`values and chroma values from two samples, which are luma sample with minimum
`
`sample value and with maximum smamplc sample inside the set of downsamplcd
`
`neighboring luma samples, and their con-esponding chroma samples).
`
`However, Chen doesnotexplicitly disclose circuitry; and memory coupledto the
`
`circuitry.
`
`In an analogousart, TSAI disclosescircuitry; and memory coupledto the
`
`circuitry([para 0097; 0102]- a circuit coupled to the entropy encoding module).
`
`Therefore, it would have been obvious to one of ordinary skill in the art before the
`
`effective filing date of the claimed invention to provide the technique of TSAI to the
`
`modified system of Chen block partition of luma and chroma blocks using separate
`
`partition trees in video coding and also control schemes of dependent cross component
`
`coding to reduce complexity or required system resources [| TSAI; paragraph 0002].
`
`

`

`Application/Control Number: 16/875,553
`Art Unit: 2487
`
`Page 6
`
`Regarding claim 2, TSAI discloses determines whether to split the current luma
`
`VPDU into smaller blocks based on a split flag associated with the VPDU([para 0059
`
`and 0059]-chroma and luma split flag).
`
`Regarding claim 3, Chen teaches determines whether to split the current luma
`
`VPDU into smaller blocks based on a quad-tree split depth of a luma block([see in Fig. 1
`
`and section: 3.1 VVC coding architecture]- CTU is split using a quad-tree with nested
`
`multi-type tree structure into coding units (CUs); [see also in section: 3.2.2 Partitioning
`
`of the CTUs using a tree structure]).
`
`Regarding claim 4, Chen teaches wherein the circuitry, in operation, determines
`
`whether to split the current luma VPDU into smaller blocks based on a threshold block
`
`size([see in section: 3.2.2- Partitioning of the CTUs using a tree structure]- size of the
`
`CU maybeas large as the CTU or as small as 4x4 in units of luma samples. For the
`
`case of the 4:2:0 chroma format, the maximum chroma CB size is 64x64 and the
`
`minimum chroma CB size is 2x2; [see also section: 3. 7.3.3.1-LMCS parameter
`
`estimation for SDR).
`
`Claim 5, Chen teaches wherein the threshold block size is a default block size or
`
`a signaled block size([see in section: 3.2.2- Partitioning of the CTUs using a tree
`
`structure]- size of the CU may be aslarge as the CTU or as small as 4x4 in units of
`
`luma samples. For the case of the 4:2:0 chroma format, the maximum chroma CB size
`
`is 64x64 and the minimum chroma CB size is 2x2; [see also section: 3. 7.3.3.1-LMCS
`
`parameter estimation for SDR).
`
`Regarding claim 6, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 1.Hence; all limitations for claim 6 have been metin claim 1. Chen
`
`

`

`Application/Control Number: 16/875,553
`Art Unit: 2487
`
`Page 7
`
`teaches a block splitter, which, in operation, splits a first image into a plurality of
`
`blocks([section: 3.1-3.2]- The picture partitioning strncture, which is further described in
`
`section 3.2, divides the input video into blocks called coding tree units (CTUs). A CTU is
`
`split using a quad-tree with nested multi-type tree structure into coding units (CUs), with
`
`a leaf coding unit (CU) defining a region sharing the same prediction mode(e.g. intra or
`
`inter)); an intra predictor, which, in operation, predicts blocks includedin thefirst
`
`image, using reference blocksincludedin the first image([section: 3.1-3.2]- The
`
`picture partitioning structure, which is further described in section 3.2, divides the input
`
`video into blocks called coding tree units (CTUs). A CTU is split using a quad-tree with
`
`nested multi-type tree structure into coding units (CUs), with a leaf coding unit (CU)
`
`defining a region sharing the same prediction mode (e.g. intra or inter); it is understood
`
`that intra-prediction always use referencepicture or block for prediction purpose); an
`
`inter predictor, which, in operation, predicts blocks includedin thefirst image,
`
`using reference blocks included in a second image different from the first
`
`image([see in fig. 1-2 and section: 3.1-3.2]- The picture partitioning structure, which is
`
`further described in section 3.2, divides the input video into blocks called coding tree
`
`units (CTUs). A CTU is split using a quad-tree with nested multi-type tree structure into
`
`coding units (CUs), with a leaf coding unit (CU) defining a region sharing the same
`
`prediction mode (e.g. intra or inter); it is understood that intra-prediction always use
`
`reference picture or block for prediction purpose); a loop filter, which, in operation,
`
`filters blocks includedin the first image([see in fig. 1-2 and section: 3.1-3.2]- The
`
`other features of VITM4, including intra prediction processes, inter picture prediction
`
`processes. transform and quantization processes, entropy coding processes and in-loop
`
`

`

`Application/Control Number: 16/875,553
`Art Unit: 2487
`
`Page 8
`
`filter processes, are covered in sections 3.3 to 3.7) ; a transformer, which, in
`
`operation, transforms a prediction error between an original signal and a
`
`prediction signal generated by the intra predictor or the inter predictor, to
`
`generate transform coefficients([see in Fig. 1]- combining inter-picture and intra-
`
`picture prediction and transform coding with entropy coding. Figure | shows a general
`
`block diagram of the VTM4 encoder); a quantizer, which, in operation, quantizes the
`
`transform coefficients to generate quantized coefficients([see in Fig. 1]-fig.
`
`1 a
`
`General block diagram ol’ VTM4 encoderincluding intra prediction processes, inter
`
`picture prediction processes. transform and quantization processes, entropy coding
`
`processes andin-loop filter processes); and an entropy encoder, which, in operation,
`
`variable encodes the quantized coefficients to generate an encoded bitstream
`
`including the encoded quantized coefficients and control information(([see in Fig.
`
`1]-fig.
`
`1 a General block diagram ol' VTM4 encoder including intra prediction processes,
`
`inter picture prediction processes. transform and quantization processes, entropy
`
`coding processes and in-loop filter processes; ([see in fig. 1-2 and section: 3.1-3.2]- The
`
`other features of VTM4, including intra prediction processes, inter picture prediction
`
`processes. transform and quantization processes, entropy coding processes and in-loop
`
`filter processes, are covered in sections 3.3 to 3.7)).
`
`Regarding claim 7, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 2.
`
`Regarding claim 8, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 3.
`
`

`

`Application/Control Number: 16/875,553
`Art Unit: 2487
`
`Page 9
`
`Regarding claim 9, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 4.
`
`Regarding claim 10, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 5.
`
`Regarding claims 11 and 12, the claim is interpreted and rejected for the same
`
`reason as setforth in claim 1.Hence; all limitations for claims 11 and 12 have been met
`
`in claim 1.
`
`Regarding claim 13, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 2.
`
`Regarding claim 14, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 3.
`
`Regarding claim 15, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 4.
`
`Regarding claim 16 and 17, the claim is interpreted and rejected for the same
`
`reason as setforth in claim 5.
`
`Regarding claim 18, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 6.Hence; all limitations for claim 18 have been metin claim 6.
`
`Regarding claim 19, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 2.
`
`Regarding claim 20, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 3.
`
`Regarding claim 21, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 4.
`
`

`

`Application/Control Number: 16/875,553
`Art Unit: 2487
`
`Page 10
`
`Regarding claim 22, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 5.
`
`Regarding claims 23 and 24, the claim is interpreted and rejected for the same
`
`reason as setforth in claim 1.Hence; all limitations for claims 23 and 24 have been met
`
`in claim 1.
`
`Regarding claim 25, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 2.
`
`Regarding claim 26, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 3.
`
`Regarding claim 27, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 4.
`
`Regarding claim 28, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 5.
`
`Regarding claim 29, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 1.Hence; all limitations for claim 29 have been metin claim 1.
`
`Regarding claim 30, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 2.
`
`Regarding claim 31, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 3.
`
`Regarding claim 32, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 4.
`
`

`

`Application/Control Number: 16/875,553
`Art Unit: 2487
`
`Page 11
`
`Regarding claim 33, the claim is interpreted and rejected for the same reason as
`
`set forth in claim 5.
`
`Citation of Pertinent Prior Art
`
`The prior art are made of record and not relied upon but considered pertinent to
`
`applicant’s disclosure:
`
`1.
`
`ZHAOetal., US 2020/0304815 A1, discloses methods and an apparatus
`
`including processing circuitry that decodes coded information of a coding block (CB)in
`
`a picture from a codedvideo bitstream..
`
`2.
`
`XU et. al., US 2020/0112735 A1, discloses methods and apparatusesfor video
`
`encoding/decoding.
`
`3.
`
`Han et al., US. 2020/0260107 A1, disclosure describes techniquesrelated to
`
`intra block copy (IBC) mode and shared motion vector predictor list design.
`
`4.
`
`SEREGIN et al., US. 2020/0221111 A1, disclosure methods of performing
`
`improved localillumination compensation.
`
`Conclusion
`
`THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time
`
`policy as set forth in 37 CFR 1.136(a).
`
`A shortenedstatutory period for reply to this final action is set to expire THREE
`
`
`
`MONTHS from the mailing date of this action. In the eventafirst replyis filed within
`
`TWO MONTHS ofthe mailing date ofthis final action and the advisory action is not
`
`

`

`Application/Control Number: 16/875,553
`Art Unit: 2487
`
`Page 12
`
`mailed until after the end of the THREE-MONTH shortenedstatutory period, then the
`
`shortened statutory period will expire on the date the advisory action is mailed, and any
`
`extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of
`
`the advisory action.
`
`In no event, however, will the statutory period for reply expire later
`
`than SIX MONTHS from the mailing date ofthis final action.
`
`Any inquiry concerning this communication or earlier communications from the
`
`examiner should be directed to MD NAZMUL HAQUE whosetelephone number is
`
`(571)272-5328. The examiner can normally be reached on IFW.
`
`Examiner interviews are available via telephone, in-person, and video
`
`conferencing using a USPTO supplied web-based collaboration tool. To schedule an
`
`interview, applicant is encouraged to use the USPTO Automated Interview Request
`
`(AIR) at http:/Avww.uspto.gov/interviewpractice.
`
`If attempts to reach the examiner by telephone are unsuccessful, the examiner's
`
`supervisor, David Czekaj can be reached on 5712727327. The fax phone number for
`
`the organization where this application or proceeding is assigned is 571-273-8300.
`
`Information regarding the status of an application may be obtained from the
`
`Patent Application Information Retrieval (PAIR) system. Status information for
`
`published applications may be obtained from either Private PAIR or Public PAIR.
`
`Status information for unpublished applications is available through Private PAIR only.
`
`For more information about the PAIR system, see https://ppair-
`
`my.uspto.gov/pair/PrivatePair. Should you have questions on accessto the Private
`
`PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free).
`
`If you would like assistance from a USPTO Customer Service Representative or access
`
`

`

`Application/Control Number: 16/875,553
`Art Unit: 2487
`
`Page 13
`
`to the automated information system, call 800-786-9199 (IN USA OR CANADA)or 571-
`
`272-1000.
`
`/MD N HAQUE/
`Primary Examiner, Art Unit 2487
`
`