Commit graph

4561 commits

Author SHA1 Message Date
Joose Sainio a45ad25dde [mtt] Fix counting the number of reference pixles and implement WAIP adjustment 2022-11-24 09:29:36 +02:00
Joose Sainio ecc1e3ec89 [mtt] WIP 2022-11-24 09:29:00 +02:00
Joose Sainio f1f46d6008 WIP 2022-11-24 09:26:10 +02:00
Joose Sainio 902ea84187 [mtt] square root adjustment for quantization 2022-11-24 09:23:14 +02:00
Joose Sainio 6fe09411c0 WIP 2022-11-24 09:23:14 +02:00
Joose Sainio 540cf1fa41 [mtt] WIP 2022-11-24 09:23:14 +02:00
Joose Sainio 8a86c8fe3c [mtt] remove work_tree 2022-11-24 09:23:14 +02:00
Joose Sainio 3e119d5338 [mtt] Remove work_tree_copy_down and change work_tree_copy_up not to require the whole work tree as input parameter 2022-11-24 09:23:13 +02:00
Joose Sainio 27726dc375 [mtt] fix dual tree 2022-11-24 09:23:13 +02:00
Joose Sainio df01d5488f [quant] fix fast coeff cost 2022-11-24 09:23:13 +02:00
Joose Sainio 80bd15e6c7 [mtt] fix 2022-11-24 09:22:17 +02:00
Joose Sainio 97001eab7f [mtt] fix 2022-11-24 09:22:17 +02:00
Joose Sainio 0b4d215456 [mtt] fix 2022-11-24 09:22:17 +02:00
Joose Sainio a2ddb630e4 [mtt] also copy top right CU 2022-11-24 09:22:16 +02:00
Joose Sainio 1f3d21362f [mtt] temporarily disable zero coeff rdo 2022-11-24 09:22:16 +02:00
Joose Sainio eda0ead6f4 [mtt] fix 2022-11-24 09:22:16 +02:00
Joose Sainio c9c331ed38 [mtt] fix 2022-11-24 09:22:16 +02:00
Joose Sainio d538061142 [mtt] Only initialize higher depth ctus partially 2022-11-24 09:22:16 +02:00
Joose Sainio 11abe38295 [transform] Simplify chroma transform search a bit 2022-11-24 09:22:16 +02:00
Joose Sainio ec72cbf3ea [mtt] Add function for easily getting all split cu_locs 2022-11-24 09:22:15 +02:00
Joose Sainio b6c36f07ac [mtt] Remove depth from cu_info_t 2022-11-24 09:22:15 +02:00
Joose Sainio 72196bbadb [mtt] Completely remove tr_depth 2022-11-24 09:20:50 +02:00
Joose Sainio 97507b6c30 [mtt] remove depth from cbf 2022-11-24 09:19:47 +02:00
Joose Sainio 97296022a3 [mtt] remove dependency to depth from deblock 2022-11-24 09:19:25 +02:00
Joose Sainio 6b15346841 [mtt] remove unnecessary depth dependency from split flag 2022-11-24 09:19:25 +02:00
Joose Sainio ce754ba991 [mtt] remove lfnst dependency to depth 2022-11-24 09:19:25 +02:00
Joose Sainio cdc3b40733 wip 2022-11-24 09:17:22 +02:00
Joose Sainio bfa91a009a [mtt] Actually remove the last width dependency to depth 2022-11-24 09:15:25 +02:00
Joose Sainio 2e81b73e12 [mtt] remove all rest usages of deriving width and height from depth 2022-11-24 09:12:59 +02:00
Joose Sainio 0134f07949 [mtt] change most if not all of search hierarchy to use cu_loc_t 2022-11-24 09:06:14 +02:00
siivonek 36cda011e0 [isp] Fix reference building. When ISP was in use, not enough samples were generated. Uninitialized memory was referenced. Fix some typos. 2022-10-12 16:19:22 +03:00
siivonek a637b44d31 [isp] Remove some obsolete TODOs and old commented out code. 2022-10-11 16:11:14 +03:00
siivonek b7a064fcce [isp] Fix error in mts tests. CU isp mode was not nullified before testing. 2022-10-07 02:14:45 +03:00
siivonek ce2c9331de [isp] Fix some CI errors. Some const modifiers were discarded. 2022-10-03 13:13:56 +03:00
siivonek aa696dd17a [lfnst] Fix LFNST error when MIP enabled. 2022-09-29 15:41:33 +03:00
siivonek 0b44c429bd [isp] Fix lfnst constraint check when ISP is used. Remove some obsolete comments. 2022-09-28 12:38:02 +03:00
siivonek c4660d7686 [isp] Fix search. Best LFNST and MTS modes were not selected correctly for ISP modes. 2022-09-27 14:10:03 +03:00
siivonek db20e998b0 [isp] Fix transform selection when MTS & ISP is used. Wrong transform was selected. Change mts parameter name to better reflect its purpose. 2022-09-27 13:12:10 +03:00
siivonek bd2e588a22 [isp] Add lfnst asserts. Fix error in MTS search. Fix chroma lfnst index when no coefficients present. 2022-09-26 14:44:51 +03:00
siivonek 6975febccf [isp] Fix lfnst constraint checks when ISP is in use. Add some asserts. 2022-09-23 15:41:50 +03:00
siivonek 85029fc2ca [isp] Remove unnecessary code from forward dct 32. 2022-09-22 16:49:09 +03:00
siivonek 9671c4551e [isp] Disable fast residual cost calculation from ISP related CI tests. 2022-09-22 15:07:16 +03:00
siivonek 785ae95302 [isp] Use TR_MAX_WIDTH in ISP checks instead of parameter. 2022-09-22 14:28:40 +03:00
siivonek 18fca3798b [isp] Limit ISP search to block size 32. Size 64 is not allowed. 2022-09-21 12:55:07 +03:00
siivonek d059db1f65 [isp] Add CI tests. 2022-09-20 18:01:49 +03:00
siivonek e9c3351460 [isp] Add ISP checks to search. LFNST can be used with ISP for larger blocks. Transform skip cannot be used with ISP. 2022-09-20 17:44:10 +03:00
siivonek d553bbba8a [isp] Fix CI errors. 2022-09-20 16:15:23 +03:00
siivonek 80945c985a [isp] Fix cabac issues. There are always four transform blocks even if there are only two ISP splits. Fix prediction issues. PDPC filter was applied when it should be disabled. Fix reference building issues. Left reference was built incorrectly for blocks with height 2. 2022-09-20 15:16:14 +03:00
siivonek e8779fc175 [isp] Fix storing cbfs for small ISP splits. Fix pdpc filtering. Cannot be used if width or height is less than 4. Fix dct related CI errors. 2022-09-16 15:46:31 +03:00
siivonek c46abbdaa1 [isp] Fix some asserts to allow log2_dim 1 block sizes. Fix coefficient group scan order for small dimensions. 2022-09-16 10:37:51 +03:00