UNITED STATES PATENT AND TRADEMARK OFFICE
`
`
`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and Trademark Office
`Address: COMMISSIONER FOR PATENTS
`P.O. Box 1450
`Alexandria, Virginia 2231371450
`www.uspto.gov
`
`13/993,230
`
`06/11/2013
`
`Toshiyasu SugiO
`
`2013-0857A
`
`2522
`
`52349
`
`759°
`
`03/14/20”
`
`WENDEROTH, LIND & PONACK L.L.P.
`1030 15th Street, N.W.
`Suite 400 East
`
`Washington, DC 20005-1503
`
`LEE'HMMYS
`
`ART UNIT
`2486
`
`PAPER NUMBER
`
`NOTIFICATION DATE
`
`DELIVERY MODE
`
`03/14/2019
`
`ELECTRONIC
`
`Please find below and/or attached an Office communication concerning this application or proceeding.
`
`The time period for reply, if any, is set in the attached communication.
`
`Notice of the Office communication was sent electronically on above—indicated "Notification Date" to the
`
`following e—mail address(es):
`eoa @ wenderoth. com
`kmiller @ wenderotheom
`
`PTOL-90A (Rev. 04/07)
`
`

`

`0/7709 A0170” Summary
`
`Application No.
`13/993,230
`Examiner
`JIMMY 8 LEE
`
`Applicant(s)
`Sugio et al.
`Art Unit
`2486
`
`AIA (FITF) Status
`No
`
`- The MAILING DA TE of this communication appears on the cover sheet wit/7 the correspondence address -
`Period for Reply
`
`A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE g MONTHS FROM THE MAILING
`DATE OF THIS COMMUNICATION.
`Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed after SIX (6) MONTHS from the mailing
`date of this communication.
`|f NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication.
`-
`- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133).
`Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any earned patent term
`adjustment. See 37 CFR 1.704(b).
`
`Status
`
`1). Responsive to communication(s) filed on 9/25/18.
`[:1 A declaration(s)/affidavit(s) under 37 CFR 1.130(b) was/were filed on
`
`2a)D This action is FINAL.
`
`2b)
`
`This action is non-final.
`
`3)[:] An election was made by the applicant in response to a restriction requirement set forth during the interview on
`; the restriction requirement and election have been incorporated into this action.
`
`4)[:] Since this application is in condition for allowance except for formal matters, prosecution as to the merits is
`closed in accordance with the practice under Expat/7e Quay/e, 1935 CD. 11, 453 O.G. 213.
`
`Disposition of Claims*
`5)
`Claim(s)
`
`3,5,10,12 and 15—17is/are pending in the application.
`
`5a) Of the above claim(s)
`
`is/are withdrawn from consideration.
`
`E] Claim(s)
`
`is/are allowed.
`
`Claim(s) 3,5,10,12 and 15—17 is/are rejected.
`
`[:1 Claim(s)
`
`is/are objected to.
`
`) ) ) )
`
`6 7
`
`8
`
`
`
`are subject to restriction and/or election requirement
`[j Claim(s)
`9
`* If any claims have been determined aflowabie. you may be eligible to benefit from the Patent Prosecution Highway program at a
`
`participating intellectual property office for the corresponding application. For more information, please see
`
`http://www.uspto.gov/patents/init events/pph/index.jsp or send an inquiry to PPeredback@uspto.gov.
`
`Application Papers
`10)[:] The specification is objected to by the Examiner.
`
`11)[:] The drawing(s) filed on
`
`is/are: a)D accepted or b)l:] objected to by the Examiner.
`
`Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a).
`Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121 (d).
`
`Priority under 35 U.S.C. § 119
`12):] Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f).
`Certified copies:
`
`a)D All
`
`b)I:I Some**
`
`c)C] None of the:
`
`1.[:] Certified copies of the priority documents have been received.
`
`2.[:] Certified copies of the priority documents have been received in Application No.
`
`3.[:] Copies of the certified copies of the priority documents have been received in this National Stage
`application from the International Bureau (PCT Rule 17.2(a)).
`
`** See the attached detailed Office action for a list of the certified copies not received.
`
`Attachment(s)
`
`1)
`
`Notice of References Cited (PTO-892)
`
`Information Disclosure Statement(s) (PTO/SB/08a and/or PTO/SB/08b)
`2)
`Paper No(s)/Mail Datew.
`U.S. Patent and Trademark Office
`
`3) C] Interview Summary (PTO-413)
`Paper No(s)/Mail Date
`4) CI Other-
`
`PTOL-326 (Rev. 11-13)
`
`Office Action Summary
`
`Part of Paper No./Mai| Date 20190214
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 2
`
`DETAILED ACTION
`
`Notice of Pre-AIA or AIA Status
`
`The present application is being examined under the pre-AIA first to invent provisions.
`
`Continued Examination Under 37 CFR 1.114
`
`A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 1.17(e),
`
`was filed in this application after final rejection. Since this application is eligible for continued
`
`examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) has been timely paid, the
`
`finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's
`
`submission filed on 9/25/2018 has been entered.
`
`Response to Arguments
`
`Applicant's arguments filed 9/25/2018 have been fully considered but they are not persuasive. In
`
`particular, the applicant argues that Hagai does not sufficiently teach the concept of ”selection is made
`
`between one of (i) the bi-directional prediction and (ii) uni-directional prediction for coding with
`
`reference to one reference picture as the prediction direction of the current block” since they do not
`
`recognize a selection of one of either reference picture as occurring in the prior art, Hagai. However,
`
`merely stating a selection is made between one of the two does not mean that there is a separate type
`
`of selection since no disclosure of what is exactly meant by this type of selection. In other words, a
`
`selection of a prediction between one bi-directional prediction and uni-directional prediction, without
`
`explanation of what the selection is based on or how the selection is made, amounts to the indication of
`
`at least one of the two types being used for referencing the prediction direction. This, Hagai does still
`
`teach since the cited aspect of the invention further reduces to after selection of either direct mode or
`
`other than direct mode is to choose directly from the motion estimation unit 909. This occurs when the
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 3
`
`motion estimation unit 909 obtains a reference picture RP stored in the multi frame buffer 907 based on
`
`a first reference picture prediction or second reference picture prediction, 1173 and 74. Further 1174
`
`indicates that from motion estimation unit 909, one reference picture is sent as the outputted
`
`prediction selection once selected, meaning that it is similar to unidirectional prediction for coding with
`
`reference to one reference picture. There also exists a similar teaching relates as well to the decoding
`
`aspect of the prior art since using a similar architecture allows for determination of the reference image
`
`based on a direct mode or not from direct mode selection for reference picture determination as can be
`
`seen from Fig. 9. For this reason, Hagai is still considered to teach the claimed invention since from
`
`determination of either direct mode or a mode other than direct mode results in outputting one
`
`reference index as explained in 1174.
`
`Claim Rejections - 35 USC § 103
`
`The following is a quotation of pre-AIA 35 U.S.C. 103(a) which forms the basis for all obviousness
`
`rejections set forth in this Office action:
`
`(a) A patent may not be obtained though the invention is not identically disclosed or described as set
`forth in section 102 of this title, if the differences between the subject matter sought to be patented
`and the prior art are such that the subject matter as a whole would have been obvious at the time the
`invention was made to a person having ordinary skill in the art to which said subject matter pertains.
`Patentability shall not be negatived by the manner in which the invention was made.
`
`The factual inquiries set forth in Graham v. John Deere C0,, 383 U.S. 1, 148 USPQ 459 (1966), that are
`
`applied for establishing a background for determining obviousness under pre-AIA 35 U.S.C. 103(a) are
`
`summarized as follows:
`
`1. Determining the scope and contents of the prior art.
`
`2. Ascertaining the differences between the prior art and the claims at issue.
`
`3. Resolving the level of ordinary skill in the pertinent art.
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 4
`
`4. Considering objective evidence present in the application indicating obviousness or
`
`nonobviousness.
`
`1.
`
`Claims 3 and 10 are rejected under pre-AIA 35 U.S.C. 103(a) as being taught by Suzuki et al. (US
`
`20070291131 A1) in view of Kate et al. (US 20030215014 A1) in view of Nakagami; Ohji et al. (US
`
`20110293195 A1)
`
`Regarding claim 3, Suzuki teaches,
`
`An image coding method for coding ("controlling image coding mode")[title], using inter
`
`prediction, ("images are coded using a predictive mode containing the inter-frame
`
`unidirectional predictive coding mode and the inter-frame bidirectional predictive coding
`
`mode")[1119] a current block included in a current picture, (”frames 310" contains. a frame
`
`header 312 and “a piuraiity of macrobiocks 32%"ilsfilefifil the image coding method comprising:
`
`adding, into header data, a prediction direction fixing information ("decision flag is
`
`appended to a frame header")[11141, Fig. 19] indicating that a prediction direction
`
`(decision flag appended for "each frame that B-VOP refers to a backward
`
`direction")[11136] for coding all blocks using inter prediction in the entire current
`
`picture (image coded is "B picture or B-VOP" with a determination if bidirectional
`
`coding is to be used as "inter-frame coding")[1]63, 69] in a predetermined coding mode
`
`is fixed to one of a uni-prediction and bi-prediction; ("coded by the inter-frame
`
`bidirectional predictive modE")[1ll39] and
`
`coding the entire current block ("coded data sequence" generated by the image coding
`
`apparatus 18)[11139] in the predetermined coding mode, ("when the coding of a frame
`
`to be coded" was completed "coding mode information outputted")[1ll30] based on
`
`the prediction direction fixing information (a ""not_coded" flag 326" stored in a
`
`macroblock header 322, which is part of a data structure of coded data sequence
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 5
`
`generated by image coding apparatus 18 [11139, Fig. 18-21], which stores of P-VOP
`
`which is, "a frame that B-VOP refers to in a backward direction")[1l142]
`
`wherein predetermined coding mode is a direct mode, (reference mode selection
`
`circuit 38 will output frame predictive mode information to indicate "coding is
`
`performed using the forward predictive mode provided with the global motion
`
`vector")[1l106]
`
`a prediction direction flag ("decision flag")[1]139] indicating the selected prediction
`
`direction (frame refers to "a forward direction or difference data")[1]139] is added into
`
`a bitstream. (with coded data sequence "contains a decision flag")[1]139]
`
`But does not explicitly teach,
`
`coding, using the bi-prediction, all the blocks coded using inter prediction when the
`
`prediction direction fixing information indicates that the prediction is fixed to the bi-
`
`prediction;
`
`when the prediction direction flag is ON in the direct mode, the prediction direction in
`
`the direct mode is set to bi-directional prediction for coding with reference to two or
`
`more reference pictures; and
`
`when the prediction direction fixing flag is OFF in the direct mode, a selection is made
`
`between (i) the bi-directional prediction and (ii) uni-directional prediction for coding
`
`with reference to one reference picture as the prediction direction of the current block
`
`However, Nakagami teaches,
`
`coding, using the bi-prediction, ("execution of a bi-directional prediction by motion
`
`vector scaling")[1]171] all the blocks coded ("macroblock 61” is encoded)[1l171] using
`
`inter prediction ("motion compensation prediction" corresponding to the "inter-frame
`
`distance" used for motion vectors of "forward and backward predictions" that relate
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 6
`
`to the "above prediction mode")[11169,171, Fig. 30] when the prediction direction
`
`fixing information ("flag indicating the above prediction mode")[11171] indicates that
`
`the prediction is fixed to the bi-prediction; ("i.e., the execution of a bi-directional
`
`prediction by motion vector scaling" flagged for encoding)[1]171]
`
`It would be obvious to one with ordinary skill in the art to combine the image code mode
`
`control of Suzuki with the motion vector encoding of Koto to apply a scaled prediction for bi-
`
`directional prediction. The reason for this would be to provide for reference frame skipping
`
`conditions which allow macroblock skipping to improve encoding efficiency.
`
`But does not explicitly teach,
`
`when the prediction direction flag is ON in the direct mode, the prediction direction in
`
`the direct mode is set to bi-directional prediction for coding with reference to two or
`
`more reference pictures; and
`
`when the prediction direction fixing flag is OFF in the direct mode, a selection is made
`
`between one of (i) the bi-directional prediction and (ii) uni-directional prediction for
`
`coding with reference to one reference picture as the prediction direction of the current
`
`block
`
`However, in the same field of endeavor, Nakagami teaches,
`
`wherein predetermined coding mode ("filtering prediction mode")[11152] is a direct
`
`mode, ("the image that is obtained by adding an image representing a high-frequency
`
`component to the motion compensation image MCO is generated as a prediction
`
`image")[11152]
`
`when the prediction direction flag ("identification flag")[1]173,176,177] is ON in the
`
`direct mode, (step of $31 which "step $31 that the identification flag represents that a
`
`process is to be performed in the filtering prediction m0d6")[11173,176] the prediction
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 7
`
`direction in the direct mode is set to bi-directional prediction for coding with reference
`
`to two or more reference pictures; (such that filtering prediction modes is based on
`
`"prediction circuit 44 toward the filtering circuit 45 represents that two motion
`
`compensation images are supplied")[11123,173-177] and
`
`when the prediction direction fixing flag ("identification flag")[1]173,176,177] is OFF in
`
`the direct mode, (step of $31 which "step $31 that the identification flag does not
`
`represent that a process is to be performed in the filtering prediction
`
`mode")[11173,176] a selection is made between one of (i) the bi-directional prediction
`
`and (ii) ("process is to be performed in the bidirectional prediction")[1ll77] uni-
`
`directional prediction ("process is performed in the unidirectional prediction
`
`mode")[11177] for coding with reference to one reference picture as the prediction
`
`direction of the current block ("generating a frame to be encoded B0 through
`
`bidirectional prediction "using encoded frames at temporally past and future times
`
`with respect to the current time as reference frames" which explains the bidirectional
`
`prediction used)[1111, Fig. 2, Fig. 12] ("conventional unidirectional prediction, even
`
`when a plurality of reference frames can be selected")[1120]
`
`It would be obvious to one with ordinary skill in the art to combine the image code mode
`
`control of Suzuki with the motion vector encoding of Koto with the image processing of
`
`Nakagami which evaluates the identification flag for a prediction type. The benefit this provides
`
`is a controlled filtered prediction in two directions can be considered in the same time as
`
`prediction in traditional unidirectional or bidirectional prediction, giving more prediction type
`
`choices.
`
`Regarding claim 10, Suzuki teaches,
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 8
`
`An image decoding method for decoding i"image decoding apparatus 350")[11145, Fig. 22],
`
`using inter prediction, ("images are coded using a predictive mode containing the inter-frame
`
`unidirectional predictive coding mode and the inter-frame bidirectional predictive coding
`
`mode")[1119] a current biock incidded in a current picture. Firemes 319" centering a treme
`
`header 312 and “a piuraiity cit macrobiecke 32%"iisfilddi the image decoding method
`
`cornericing:
`
`decoding, from a oitstreain, (“coding decision circuit 38% ateuirefiifiildfl a prediction
`
`direction fixing information ("decision flag is appended to a frame header")[1ll41, Fig.
`
`19] indicating that a prediction direction ("flag information 316 indicating" whether
`
`this VOP has difference data or not in a frame header 312 of B-VOP or a "frame header
`
`312 of a frame B-VOP refers to a backward direction")[11141] fer decoding all blocks
`
`using inter prediction in the entire current picture ("decision flag may be appended for
`
`each B-VOP" where image coded is "B picture or B-VOP" with a determination if
`
`bidirectional coding is to be used as "inter-frame coding")[1]136,63, 69] in a
`
`predetermined decoding mode is fixed to one oi a uni-prediction and a hi-predictien
`
`("coded by the inter-frame bidirectional predictive m0d8")[11139]
`
`deceding the entire current bioci; {whether a first code hiocit coded by the intern-frame
`
`bidirectionai predictive medeiifiiflli in the predetermined decoding mode, (“image
`
`decoding apparatus 35%} decodes frernec coded in an internframe bidirectienei
`
`predictive mode'liiiiiiiid, Fig, 24} based on the prediction direction fixing intermation (a
`
`""not_coded" flag 326"" stored in a macroblock header 322, which is part of a data
`
`structure of coded data sequence generated by image coding apparatus 18 [11139, Fig.
`
`18-21], which stores of P-VOP which is, "a frame that B-VOP refers to in a backward
`
`direction")[1ll42]
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 9
`
`wherein predetermined decoding mode is a direct mode, (reference mode selection
`
`circuit 38 will output frame predictive mode information to indicate "coding is
`
`performed using the forward predictive mode provided with the global motion
`
`vector")[1l106]
`
`a prediction direction flag ("decision flag")[1]149] in the direct mode (decision flag
`
`refers to "a forward direction or difference data")[1]139] is decoded form the bitstream
`
`("decoding method decision circuity 380 acquires a decision flag")[1]149] and the
`
`current block ("macroblock")[11149] is decoded based on the decoded prediction
`
`direction flag, ("if the decision flag is of a value indicating
`
`the decoding method
`
`" ll
`
`decision circuit 380 instructs" that the "difference data to be decoded to generate and
`
`image of the macroblock")[1l149]
`
`But does not explicitly teach,
`
`decoding, using the bi~prediction, aii the hiocks decoded using inter prediction when the
`
`prediction direction fixing information indicates that the prediction direction is fixed to
`
`the bi-prediction;
`
`when the prediction direction flag is ON in the direct mode, the prediction direction in
`
`the direct mode is set to bi-directional prediction for coding with reference to two or
`
`more reference pictures; and
`
`when the prediction direction fixing flag is OFF in the direct mode, a selection is made
`
`between one of (i) the bi-directional prediction and (ii) uni-directional prediction for
`
`coding with reference to one reference picture as the prediction direction of the current
`
`block
`
`However, Koto teaches,
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 10
`
`decoding, ("decoding the frame f3")[11172] using the bi-prediction, ("performing bi-
`
`directional predictive decoding")[1]172] all the blocks coded ("motion vector of
`
`respective macroblocks of the decoded frame F3")[11172] using inter prediction
`
`("motion compensation prediction" corresponding to the "inter-frame distance" used
`
`for motion vectors of "forward and backward predictions" that relate to the
`
`"prediction mode" with respect to the "macroblock")[11169,172, Fig. 30] when the
`
`prediction direction fixing information ("which the flag indicating the above prediction
`
`mode is set")[11172] indicates that the prediction is fixed to the bi-prediction; ("motion
`
`vectors for forward and backward predictions at the macroblock 60 are calculated" for
`
`performing "bi-directional predictive decoding" based on "flag indicating the above
`
`prediction mode is set")[11172]
`
`It would be obvious to one with ordinary skill in the art to combine the image code mode
`
`control of Suzuki with the motion vector encoding of Koto to apply a scaled prediction for bi-
`
`directional prediction. The reason for this would be to provide for reference frame skipping
`
`conditions which allow macroblock skipping to improve encoding efficiency.
`
`But does not explicitly teach,
`
`when the prediction direction flag is ON in the direct mode, the prediction direction in
`
`the direct mode is set to bi-directional prediction for coding with reference to two or
`
`more reference pictures; and
`
`when the prediction direction fixing flag is OFF in the direct mode, a selection is made
`
`between one of (i) the bi-directional prediction and (ii) uni-directional prediction for
`
`coding with reference to one reference picture as the prediction direction of the current
`
`block
`
`However, in the same field of endeavor, Nakagami teaches,
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 11
`
`wherein predetermined coding mode ("filtering prediction mode")[11152] is a direct
`
`mode, ("the image that is obtained by adding an image representing a high-frequency
`
`component to the motion compensation image MCO is generated as a prediction
`
`image")[11152]
`
`when the prediction direction flag ("identification flag")[1]173,176,177] is ON in the
`
`direct mode, (step of $31 which "step $31 that the identification flag represents that a
`
`process is to be performed in the filtering prediction m0d6")[11173,176] the prediction
`
`direction in the direct mode is set to bi-directional prediction for coding with reference
`
`to two or more reference pictures; (such that filtering prediction modes is based on
`
`"prediction circuit 44 toward the filtering circuit 45 represents that two motion
`
`compensation images are supplied")[11123,173-177] and
`
`when the prediction direction fixing flag ("identification flag")[1]173,176,177] is OFF in
`
`the direct mode, (step of $31 which "step $31 that the identification flag does not
`
`represent that a process is to be performed in the filtering prediction
`
`mode")[11173,176] a selection is made between one of (i) the bi-directional prediction
`
`and (ii) ("process is to be performed in the bidirectional prediction")[1ll77] uni-
`
`directional prediction ("process is performed in the unidirectional prediction
`
`mode")[11177] for coding with reference to one reference picture as the prediction
`
`direction of the current block ("generating a frame to be encoded B0 through
`
`bidirectional prediction "using encoded frames at temporally past and future times
`
`with respect to the current time as reference frames" which explains the bidirectional
`
`prediction used)[1111, Fig. 2, Fig. 12] ("conventional unidirectional prediction, even
`
`when a plurality of reference frames can be selected")[1120]
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 12
`
`It would be obvious to one with ordinary skill in the art to combine the image code mode
`
`control of Suzuki with the motion vector encoding of Koto with the image processing of
`
`Nakagami which evaluates the identification flag for a prediction type. The benefit this provides
`
`is a controlled filtered prediction in two directions can be considered in the same time as
`
`prediction in traditional unidirectional or bidirectional prediction, giving more prediction type
`
`choices.
`
`1.
`
`Claims 5, 12, 15, and 16 are rejected under pre-AIA 35 U.S.C. 102(b) as being taught by Suzuki et
`
`al. (US 20070291131 A1) in view of Kate et al. (US 20030215014 A1) in view of Chen et al. (US
`
`20090116558 A1) in view of Nakagami; Ohji et al. (US 20110293195 A1)
`
`Regarding claim 5, Suzuki teaches,
`
`An image coding method for coding ("controlling image coding mode")[title], using inter
`
`prediction, ("images are coded using a predictive mode containing the inter-frame
`
`unidirectional predictive coding mode and the inter-frame bidirectional predictive coding
`
`mode")[1119] a current block included in a current picture, (”frames 319" contains a frame
`
`header 312 and “a plurality of macrobiocks EZQ'WWMQ} the image coding method comprising:
`
`(i) adding, into header data, ("frame header")[11141] a prediction direction fixing
`
`information ("decision flag is appended to a frame header")[11141, Fig. 19] indicating
`
`that a prediction direction (decision flag appended for "each frame that B-VOP refers
`
`to a backward direction")[11136] for coding all blocks using inter prediction in the entire
`
`current picture (image coded is "B picture or B-VOP" with a determination if
`
`bidirectional coding is to be used as "inter-frame coding")[1]63, 69] in a predetermined
`
`coding mode is fixed to one of a uni-prediction and bi-prediction ("coded by the inter-
`
`frame bidirectional predictive modE")[1ll39] and
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 13
`
`coding the current block sequence ("coded data sequence" generated by the image
`
`coding apparatus 18)[11139] in the predetermined coding mode, ("when the coding of a
`
`frame to be coded" was completed "coding mode information outputted")[1ll30]
`
`based on the prediction direction flag (a ""not_coded" flag 326" stored in a macroblock
`
`header 322, which is part of a data structure of coded data sequence generated by
`
`image coding apparatus 18 [11139], which stores of P-VOP which is, "a frame that B-
`
`VOP refers to in a backward direction")[11142] and the first prediction direction
`
`information. ("indicating whether a first block coded by the inter-frame bidirectional
`
`predictive mode")[11139]
`
`wherein predetermined coding mode is a direct mode, (reference mode selection
`
`circuit 38 will output frame predictive mode information to indicate "coding is
`
`performed using the forward predictive mode provided with the global motion
`
`vector")[11106]
`
`prediction direction identified (frame refers to "a forward direction or difference
`
`data")[11139] by the first prediction direction flag ("decision flag")[1]139] is set to the
`
`prediction direction of the current block, (with coded data sequence "contains a
`
`decision flag")[1]139]
`
`a second prediction direction flag ("decision flag" such as for a second macroblock
`
`when a decision flag is acquired for each macroblock)[1ll39,138] indicating the
`
`selected prediction direction (frame refers to "a forward direction or difference
`
`data")[11139] is added into a bitstream. (with coded data sequence "contains a
`
`decision flag")[1]139]
`
`But does not explicitly teach,
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`Page 14
`
`coding, wing the hi~predictidn, aii the biocks coded using inter prediction when the
`
`prediction direction fixing information indicates that the prediction direction is fixed to
`
`the iii-prediction, and (ii) adding, into the header data, a first prediction direction t'iag
`
`indicating the fixed prediction direction; and
`
`when the prediction direction flag is ON in the direct mode, the prediction direction in
`
`the direct mode is set to bi-directional prediction for coding with reference to two or
`
`more reference pictures; and
`
`when the prediction direction fixing flag is OFF in the direct mode, a selection is made
`
`between (i) the bi-directional prediction and (ii) uni-directional prediction for coding
`
`with reference to one reference picture as the prediction direction of the current block
`
`coding the entire current block, based on the first prediction direction information.
`
`However, Koto teaches,
`
`coding, using the bi~prediction, ("execution of a bi-directional prediction by motion
`
`vector scaling")[1]171] aii the hiocks coded ("macroblock 61” is encoded)[1ll71] using
`
`inter prediction ("motion compensation prediction" corresponding to the "inter-frame
`
`distance" used for motion vectors of "forward and backward predictions" that relate
`
`to the "above prediction mode")[11169,171, Fig. 30] when the predictien direction
`
`fixing information ("flag indicating the above prediction mode")[11171] indicates that
`
`the prediction direction is fixed to the hi-predictien, ("i.e., the execution of a bi-
`
`directional prediction by motion vector scaling" flagged for encoding)[1]171]
`
`It would be obvious to one with ordinary skill in the art to combine the image code mode
`
`control of Suzuki with the motion vector encoding of Koto to apply a scaled prediction for bi-
`
`directional prediction. The reason for this would be to provide for reference frame skipping
`
`conditions which allow macroblock skipping to improve encoding efficiency.
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`But does not teach explicitly,
`
`Page 15
`
`(ii) adding, into header data, a first prediction direction flag indicating the fixed
`
`prediction direction; and
`
`when the prediction direction flag is ON in the direct mode, the prediction direction in
`
`the direct mode is set to bi-directional prediction for coding with reference to two or
`
`more reference pictures; and
`
`when the prediction direction fixing flag is OFF in the direct mode, a selection is made
`
`between (i) the bi-directional prediction and (ii) uni-directional prediction for coding
`
`with reference to one reference picture as the prediction direction of the current block
`
`coding the entire current block, based on the first prediction direction information.
`
`However, Chen teaches additionally,
`
`(ii) adding, into header data, (inter-view reference picture used "is signaled" used for
`
`skip motion as used for motion skip)[1]109, Fig. 10] a first prediction direction flag
`
`("flag is signaled" to select one of the "two selected inter-view reference
`
`pictures")[11109] indicating the fixed prediction direction; ("flag indicating whether it is
`
`forward or backward inter-view reference picture")[11109] and
`
`coding the entire current block ("each MB to be encoded")[11110], based on the first
`
`prediction direction information. (flagging/signaling used for "selection of one inter-
`
`view reference picture" for each MB to be encoded)[11110]
`
`It would have been obvious to one with ordinary skill in the art to combine the image coding
`
`mode control of Suzuki with the motion vector encoding of Koto with the single-loop encoding
`
`of Chen to create a process where a flag determines if a forward or backward reference picture
`
`is used. The reason for this is that flagging the inter-view reference picture in this fashion,
`
`multiple inter-view reference pictures can be used.
`
`

`

`Application/Control Number: 13/993,230
`Art Unit: 2486
`
`But does not explicitly teach,
`
`Page 16
`
`when the prediction direction flag is ON in the direct mode, the prediction direction in
`
`the direct mode is set to bi-directional prediction for coding with reference to two or
`
`more reference pictures; and
`
`when the prediction direction fixing flag is OFF in the direct mode, a selection is made
`
`between (i) the bi-directional prediction and (ii) uni-directional prediction for coding
`
`with reference to one reference picture as the prediction direction of the current block
`
`However, in the same field of endeavor, Nakagami teaches,
`
`wherein predetermined coding mode ("filtering prediction mode")[11152] is a direct
`
`mode, ("the image that is obtained by adding an image representing a high-frequency
`
`component to the motion compensation image MCO is generated as a prediction
`
`image")[11152]
`
`when the prediction direction flag ("identification flag")[1]173,176,177] is ON in the
`
`direct mode, (step of $31 which "step $31 that the identification flag represents that a
`
`process is to be performed in the filtering prediction m0d6")[11173,176] the prediction
`
`direction in the direct mode is set to bi-directional prediction for coding with reference
`
`to two or more reference pictures; (such that filtering prediction modes is based on
`
`"prediction circuit 44 toward the filtering circuit 45 represents that two motion
`
`compensation images are supplied")[11123,173-177] and
`
`when the prediction direction fixing flag ("identification flag")[1]173,176,177] is OFF in
`
`the direct mode, (step of $31 which "step