Commit graph

4586 commits

Author SHA1 Message Date
Joose Sainio e54a451289 [mtt] Fix couple of issues with 64x32 CUs and non square tr skip rdoq 2023-02-08 14:50:03 +02:00
Joose Sainio b7905c7238 [ISP] Fix ISP cost calculation and DepQuant with mts 2023-02-03 14:58:36 +02:00
Joose Sainio fcb92849e0 [DepQuant] Fix isp+depquant and trskip + isp 2023-01-31 14:27:35 +02:00
Joose Sainio 44e4f72fb0 [DepQuant] Fix for mts and lfnst being quantized incorrectly during search 2023-01-23 13:39:22 +02:00
Joose Sainio e6b4cb5bb3 Merge branch 'depquant' of gitlab.tuni.fi:cs/ultravideo/vvc/uvg266 into depquant 2023-01-20 08:36:32 +02:00
Joose Sainio fd43064cfa [DepQuant] Isp and chroma 2023-01-19 16:30:47 +02:00
Joose Sainio 9f3df67718 [DepQuant] Fix 2023-01-17 15:18:13 +02:00
Joose Sainio 558b16baf1 [DepQuant] Fix 2023-01-17 11:03:14 +02:00
Joose Sainio dfda6810c5 [DepQuant] Working but not necessarily improving 2023-01-12 15:15:52 +02:00
Joose Sainio 49f6e72c00 [DepQuant] WIP: doesn't crash but bitstream is illegal and quality a lot worse 2023-01-11 14:17:18 +02:00
Joose Sainio 155be1ca3d [DepQuant] WPP: API 2023-01-11 10:12:59 +02:00
Joose Sainio 5666cf7fce [DepQuant] WIP: dequant 2023-01-11 09:25:34 +02:00
Joose Sainio 8ab7908c8e [DepQuant] WIP: compiles 2023-01-11 08:34:03 +02:00
Joose Sainio 4a911bbf2b [DepQuant] WIP: easy part done 2023-01-09 14:10:10 +02:00
Joose Sainio fd8f212a5a [DepQuant] WIP: initialization done 2023-01-09 10:26:59 +02:00
Joose Sainio 2452e06f39 [mtt] correct indexing for chroma tree 2023-01-04 11:19:01 +02:00
Joose Sainio 9e41a8bd20 [mtt] Only consider termination if the cu is completely inside the frame 2023-01-04 10:49:42 +02:00
Joose Sainio 25ab38f1ff [mtt] Early terminations for all intra 2023-01-04 09:34:34 +02:00
Joose Sainio 7fe5476be1 [mtt] search early terminations 2023-01-02 13:53:15 +02:00
Joose Sainio c591af3668 [isp] properly reset cabac context during intra search 2022-12-21 14:33:10 +02:00
Joose Sainio c64e844ac5 [deblock] fix width and height to correct order 2022-12-21 13:45:56 +02:00
Joose Sainio 573413bcf6 [isp] Keep cabac contexts up to date for the different isp tus 2022-12-21 11:53:55 +02:00
Joose Sainio 34c95a5557 [mtt] Fix rdoq for non-square blocks 2022-12-21 09:17:55 +02:00
Joose Sainio 50ae8cbc82 [deblock] Use the isp block dimensions instead of cu dimensions fro deblock 2022-12-20 11:43:28 +02:00
Joose Sainio 51ad48ea1c [isp] Fix isp bitcost calculation 2022-12-20 09:13:08 +02:00
Joose Sainio 17540abb76 [lfnst] Also chroma can only use lfnst if dimensions are minimum 4 2022-12-20 08:23:01 +02:00
Joose Sainio e941ed5fa4 [mtt] There is always at least the height or width amount reference pixels available 2022-12-19 14:43:21 +02:00
Joose Sainio ccb9d57645 [mtt] Fix reading uninitialized data for local chroma tree 2022-12-19 14:25:03 +02:00
Joose Sainio 084572c890 [mtt] Fix lfnst bit counting for 64 wide or tall chroma tree cus 2022-12-19 13:22:10 +02:00
Joose Sainio 0b1b04cbea [mtt] Set cus outside of the frame to zero for initializing partial worktree 2022-12-19 12:42:01 +02:00
Joose Sainio 3e014d659b [mtt] Fix negative indexing 2022-12-19 09:59:33 +02:00
Joose Sainio 47b6754113 [mtt] Fix ref pixel generation for the second half of 32x2 chroma cus 2022-12-19 09:36:14 +02:00
Joose Sainio c431529c0e [mtt] Fix cclm for non 64 divisible heights 2022-12-16 14:13:45 +02:00
Joose Sainio d5f78d6351 [mtt] Fix deblock for isp and properly set the limit for cclm 2022-12-16 09:37:56 +02:00
Joose Sainio 7038430646 [cclm] Fix heap corruption for non 64 divisible frames 2022-12-15 13:12:42 +02:00
Joose Sainio 62fabc60dd [mtt] fix reference building for 16x1 2022-12-15 12:41:12 +02:00
Joose Sainio 82f05ff280 [rdoq] partly fix rdoq for 16x1 and 1x16 2022-12-15 11:25:12 +02:00
Joose Sainio ef7c93ead9 [deblock] Fix incorrect direction for transform split of tall blocks at the top CTU row also for chroma 2022-12-15 10:07:47 +02:00
Joose Sainio a23e2ae5f6 [mtt] fix 2022-12-15 09:09:38 +02:00
Joose Sainio 6f80f4f1a2 [mtt] Fix ref building for 32x64 cus 2022-12-14 13:12:03 +02:00
Joose Sainio b5b2b72a24 [mtt] fix getting collocated chroma for edge cus 2022-12-14 12:33:24 +02:00
Joose Sainio 68f3191dd4 [mtt] minor fixes 2022-12-14 12:02:00 +02:00
Joose Sainio 10cda40b87 [tests] no-cpuid for test_cabac_state.sh since it now has mtt in it 2022-12-14 11:38:30 +02:00
Joose Sainio 0d067671a2 [tests] chmod +x 2022-12-14 11:35:44 +02:00
Joose Sainio e3bc4ddcbf [tests] add tests for mtt 2022-12-14 11:26:01 +02:00
Joose Sainio 2ccbb79b4d [isp] Fix coordinates 2022-12-14 10:54:52 +02:00
Joose Sainio f09d015ffe [mtt] Make sure mtt splits cannot reach a situation where search cannot be performed 2022-12-14 10:41:36 +02:00
Joose Sainio 6d6d69bb81 [mtt] Check that we are inside the CTU before checking the ctu data 2022-12-14 10:28:58 +02:00
Joose Sainio 01023c8a34 [mtt] Fix trying to get split data from depth -1 2022-12-14 10:16:51 +02:00
Joose Sainio 3d236153e3 [deblock] Fix incorrect direction for transform split of tall blocks at the top CTU row 2022-12-14 10:10:08 +02:00