4440 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Joose Sainio	72196bbadb	[mtt] Completely remove tr_depth	2022-11-24 09:20:50 +02:00
Joose Sainio	97507b6c30	[mtt] remove depth from cbf	2022-11-24 09:19:47 +02:00
Joose Sainio	97296022a3	[mtt] remove dependency to depth from deblock	2022-11-24 09:19:25 +02:00
Joose Sainio	6b15346841	[mtt] remove unnecessary depth dependency from split flag	2022-11-24 09:19:25 +02:00
Joose Sainio	ce754ba991	[mtt] remove lfnst dependency to depth	2022-11-24 09:19:25 +02:00
Joose Sainio	cdc3b40733	wip	2022-11-24 09:17:22 +02:00
Joose Sainio	bfa91a009a	[mtt] Actually remove the last width dependency to depth	2022-11-24 09:15:25 +02:00
Joose Sainio	2e81b73e12	[mtt] remove all rest usages of deriving width and height from depth	2022-11-24 09:12:59 +02:00
Joose Sainio	0134f07949	[mtt] change most if not all of search hierarchy to use cu_loc_t	2022-11-24 09:06:14 +02:00
siivonek	36cda011e0	[isp] Fix reference building. When ISP was in use, not enough samples were generated. Uninitialized memory was referenced. Fix some typos.	2022-10-12 16:19:22 +03:00
siivonek	a637b44d31	[isp] Remove some obsolete TODOs and old commented out code.	2022-10-11 16:11:14 +03:00
siivonek	b7a064fcce	[isp] Fix error in mts tests. CU isp mode was not nullified before testing.	2022-10-07 02:14:45 +03:00
siivonek	ce2c9331de	[isp] Fix some CI errors. Some const modifiers were discarded.	2022-10-03 13:13:56 +03:00
siivonek	aa696dd17a	[lfnst] Fix LFNST error when MIP enabled.	2022-09-29 15:41:33 +03:00
siivonek	0b44c429bd	[isp] Fix lfnst constraint check when ISP is used. Remove some obsolete comments.	2022-09-28 12:38:02 +03:00
siivonek	c4660d7686	[isp] Fix search. Best LFNST and MTS modes were not selected correctly for ISP modes.	2022-09-27 14:10:03 +03:00
siivonek	db20e998b0	[isp] Fix transform selection when MTS & ISP is used. Wrong transform was selected. Change mts parameter name to better reflect its purpose.	2022-09-27 13:12:10 +03:00
siivonek	bd2e588a22	[isp] Add lfnst asserts. Fix error in MTS search. Fix chroma lfnst index when no coefficients present.	2022-09-26 14:44:51 +03:00
siivonek	6975febccf	[isp] Fix lfnst constraint checks when ISP is in use. Add some asserts.	2022-09-23 15:41:50 +03:00
siivonek	85029fc2ca	[isp] Remove unnecessary code from forward dct 32.	2022-09-22 16:49:09 +03:00
siivonek	9671c4551e	[isp] Disable fast residual cost calculation from ISP related CI tests.	2022-09-22 15:07:16 +03:00
siivonek	785ae95302	[isp] Use TR_MAX_WIDTH in ISP checks instead of parameter.	2022-09-22 14:28:40 +03:00
siivonek	18fca3798b	[isp] Limit ISP search to block size 32. Size 64 is not allowed.	2022-09-21 12:55:07 +03:00
siivonek	d059db1f65	[isp] Add CI tests.	2022-09-20 18:01:49 +03:00
siivonek	e9c3351460	[isp] Add ISP checks to search. LFNST can be used with ISP for larger blocks. Transform skip cannot be used with ISP.	2022-09-20 17:44:10 +03:00
siivonek	d553bbba8a	[isp] Fix CI errors.	2022-09-20 16:15:23 +03:00
siivonek	80945c985a	[isp] Fix cabac issues. There are always four transform blocks even if there are only two ISP splits. Fix prediction issues. PDPC filter was applied when it should be disabled. Fix reference building issues. Left reference was built incorrectly for blocks with height 2.	2022-09-20 15:16:14 +03:00
siivonek	e8779fc175	[isp] Fix storing cbfs for small ISP splits. Fix pdpc filtering. Cannot be used if width or height is less than 4. Fix dct related CI errors.	2022-09-16 15:46:31 +03:00
siivonek	c46abbdaa1	[isp] Fix some asserts to allow log2_dim 1 block sizes. Fix coefficient group scan order for small dimensions.	2022-09-16 10:37:51 +03:00
siivonek	19106bfced	[isp] Implement DCT for small blocks.	2022-09-15 13:45:45 +03:00
siivonek	c894e9c6b9	[isp] Fix referene building for depth 2 blocks. Flip horizontal mode dimensions during prediction. Fix reference length during prediction when ISP enabled.	2022-09-14 15:48:49 +03:00
siivonek	124cdd4e4a	[isp] Fix luma cbf writing for ISP splits. Do not write luma cbf if first three splits had luma cbf 0.	2022-09-13 13:27:16 +03:00
siivonek	75d4de20e3	[isp] Fix CI errors.	2022-09-12 15:29:53 +03:00
siivonek	dda36aef4c	[isp] Fix errors in reference building. Use cubic filter during prediction if ISP enabled.	2022-09-12 14:41:44 +03:00
Joose Sainio	1bd3a4cb55	[isp] Use correct coordinates for depth 4 chroma tu cost calculation	2022-09-06 09:30:46 +03:00
Joose Sainio	68263f428b	[tr-skip] fix transform skip flag writing	2022-09-06 08:49:22 +03:00
siivonek	a7b26f329e	[isp] WIP	2022-09-05 18:14:59 +03:00
siivonek	790deb2504	[isp] Fix mistake in pu_loc argument passing, was not used after passing.	2022-09-05 16:57:07 +03:00
Joose Sainio	60ccdbf853	[lfnst] Fix lfnst constraint checking for the new coeff order	2022-09-05 16:51:23 +03:00
Joose Sainio	17abc7a050	[lfnst] lfnst is not allowed for transform split	2022-09-05 12:04:21 +03:00
Joose Sainio	bbae4e2b07	[jccr] Fix jccr coefficient copying	2022-09-05 11:20:09 +03:00
Joose Sainio	95b6ddbe67	[cabac] fix cbf_y context for tr splits	2022-09-05 11:10:55 +03:00
siivonek	42bea563e4	[isp] Add extra logic to reference building to accommodate ISP. Remove some asserts which were invalidated by ISP.	2022-09-02 16:10:42 +03:00
siivonek	b49a4d0a57	[isp] Fix chroma coeff writing for ISP.	2022-08-31 14:54:30 +03:00
siivonek	043e502a4f	[isp] Fix jccr coeffs.	2022-08-31 13:57:00 +03:00
siivonek	9557a20c7f	[isp] Fix coeff cost calculation. Coeff arrays were indexed wrongly.	2022-08-31 13:53:17 +03:00
siivonek	def855a027	[isp] Fix error in last sig coeff function call. Height was not used. Fix cbf writing. Fix transform skip flag writing.	2022-08-31 12:28:57 +03:00
siivonek	a7be4496d5	[isp] Fix mistake in isp cbf writing. Loop index was increased twice.	2022-08-30 12:06:43 +03:00
siivonek	c9291ec5a2	[isp] Fix mistake in function declaration.	2022-08-29 12:37:23 +03:00
siivonek	3c5479f99b	[isp] Convert functions to handle new coeff array order. Add function for getting coeff array subset. Fix assert.	2022-08-26 16:39:57 +03:00