Commit graph

288 commits

Author SHA1 Message Date
Joose Sainio ef93fe6578 [mtt] Fix lfnst and chroma coeffs and tests 2022-12-12 10:05:17 +02:00
Joose Sainio b7e7616f89 WIP 2022-12-08 14:52:01 +02:00
Joose Sainio 92ace56c41 [mtt] Fill chroma data for the whole area covered by the local separate tree chroma cu 2022-12-08 10:34:51 +02:00
Joose Sainio 01aa1e8348 [mtt] Fix implicit splits for non ctu divisible frames. 2022-12-06 14:23:31 +02:00
Joose Sainio 2e809abace [mtt] Fix isp for MTT 2022-12-06 11:23:30 +02:00
Joose Sainio d004d81603 [mtt] search works completely with everything except RDOQ deblock and ISP 2022-12-02 13:56:38 +02:00
Joose Sainio 03d15759c1 [mtt] WIP 2022-12-01 14:38:35 +02:00
Joose Sainio 76b0b35c05 [mtt] fix lfnst 2022-11-30 13:26:48 +02:00
Joose Sainio 6344812c22 [mtt] search with mtt depth 2 and dual tree works without lfnst 2022-11-30 10:43:12 +02:00
Joose Sainio b770ee656a [mtt] proper split availability checking for split flag 2022-11-29 12:51:34 +02:00
Joose Sainio 665886dc52 [mtt] fix dual tree 2022-11-29 12:14:58 +02:00
Joose Sainio e1df38bbd8 [mtt] search with depth 1 mtt kinda working 2022-11-28 11:24:55 +02:00
Joose Sainio badb834ef9 [mtt] All individual mtt splits should be working + uvg_get_possible_splits 2022-11-25 13:59:45 +02:00
Joose Sainio 4c15c0e5ab [mtt] WIP 16x16 TT split 2022-11-24 15:04:57 +02:00
Joose Sainio 2c32c48a0f fix rebase 2022-11-24 12:50:19 +02:00
Joose Sainio 472baa894f [mtt] Single mtt split works for everything else, except 16x16 with TT 2022-11-24 09:33:12 +02:00
Joose Sainio 69f66626ed [mtt] 64x32 and 32x64 2022-11-24 09:29:55 +02:00
Joose Sainio ecc1e3ec89 [mtt] WIP 2022-11-24 09:29:00 +02:00
Joose Sainio 6fe09411c0 WIP 2022-11-24 09:23:14 +02:00
Joose Sainio 540cf1fa41 [mtt] WIP 2022-11-24 09:23:14 +02:00
Joose Sainio 27726dc375 [mtt] fix dual tree 2022-11-24 09:23:13 +02:00
Joose Sainio b6c36f07ac [mtt] Remove depth from cu_info_t 2022-11-24 09:22:15 +02:00
Joose Sainio 72196bbadb [mtt] Completely remove tr_depth 2022-11-24 09:20:50 +02:00
Joose Sainio 97507b6c30 [mtt] remove depth from cbf 2022-11-24 09:19:47 +02:00
Joose Sainio 6b15346841 [mtt] remove unnecessary depth dependency from split flag 2022-11-24 09:19:25 +02:00
Joose Sainio ce754ba991 [mtt] remove lfnst dependency to depth 2022-11-24 09:19:25 +02:00
Joose Sainio cdc3b40733 wip 2022-11-24 09:17:22 +02:00
Joose Sainio bfa91a009a [mtt] Actually remove the last width dependency to depth 2022-11-24 09:15:25 +02:00
Joose Sainio 2e81b73e12 [mtt] remove all rest usages of deriving width and height from depth 2022-11-24 09:12:59 +02:00
Joose Sainio 0134f07949 [mtt] change most if not all of search hierarchy to use cu_loc_t 2022-11-24 09:06:14 +02:00
siivonek ce2c9331de [isp] Fix some CI errors. Some const modifiers were discarded. 2022-10-03 13:13:56 +03:00
siivonek 0b44c429bd [isp] Fix lfnst constraint check when ISP is used. Remove some obsolete comments. 2022-09-28 12:38:02 +03:00
siivonek bd2e588a22 [isp] Add lfnst asserts. Fix error in MTS search. Fix chroma lfnst index when no coefficients present. 2022-09-26 14:44:51 +03:00
siivonek 6975febccf [isp] Fix lfnst constraint checks when ISP is in use. Add some asserts. 2022-09-23 15:41:50 +03:00
siivonek 785ae95302 [isp] Use TR_MAX_WIDTH in ISP checks instead of parameter. 2022-09-22 14:28:40 +03:00
siivonek 80945c985a [isp] Fix cabac issues. There are always four transform blocks even if there are only two ISP splits. Fix prediction issues. PDPC filter was applied when it should be disabled. Fix reference building issues. Left reference was built incorrectly for blocks with height 2. 2022-09-20 15:16:14 +03:00
siivonek e8779fc175 [isp] Fix storing cbfs for small ISP splits. Fix pdpc filtering. Cannot be used if width or height is less than 4. Fix dct related CI errors. 2022-09-16 15:46:31 +03:00
siivonek 124cdd4e4a [isp] Fix luma cbf writing for ISP splits. Do not write luma cbf if first three splits had luma cbf 0. 2022-09-13 13:27:16 +03:00
siivonek 75d4de20e3 [isp] Fix CI errors. 2022-09-12 15:29:53 +03:00
Joose Sainio 68263f428b [tr-skip] fix transform skip flag writing 2022-09-06 08:49:22 +03:00
Joose Sainio 17abc7a050 [lfnst] lfnst is not allowed for transform split 2022-09-05 12:04:21 +03:00
Joose Sainio 95b6ddbe67 [cabac] fix cbf_y context for tr splits 2022-09-05 11:10:55 +03:00
siivonek b49a4d0a57 [isp] Fix chroma coeff writing for ISP. 2022-08-31 14:54:30 +03:00
siivonek def855a027 [isp] Fix error in last sig coeff function call. Height was not used. Fix cbf writing. Fix transform skip flag writing. 2022-08-31 12:28:57 +03:00
siivonek 3c5479f99b [isp] Convert functions to handle new coeff array order. Add function for getting coeff array subset. Fix assert. 2022-08-26 16:39:57 +03:00
siivonek efc0f13501 [isp] Redo call hierarchy to include x, y coordinates. 2022-08-24 17:12:36 +03:00
siivonek 4ffbbee606 [isp] Fix chroma width error when writing cu loc. Remove redundant IPS mode checks. 2022-08-24 15:40:14 +03:00
siivonek bc3bf8a08c [isp] Set cbfs for isp splits after search. Add helper function for isp split number. 2022-08-24 13:05:59 +03:00
siivonek 35886671df [isp] Fix mistake in isp cabac write. Intra luma mpm flag bit was checking isp when it did not need to. 2022-08-23 13:20:57 +03:00
siivonek 1125248046 [isp] Fix mistake in cost calculation. Remove some commented out code blocks. 2022-08-22 14:39:36 +03:00