[Bug]: Huge user playlists (in the 1000s and 10,000s range) take a long time to load and display, leaving the Playlist view does so as well, and so does viewing the next video in the playlist

[Gorrrg]

Guidelines

• I have encountered this bug in the latest release of FreeTube.
• I have encountered this bug in the official downloads of FreeTube.
• I have searched the issue tracker for open and closed issues that are similar to the bug report I want to file, without success.
• I have searched the documentation for information that matches the description of the bug I want to file, without success.
• This issue contains only one bug.

Describe the bug

1. Have a significantly huge playlist, mine has over 17,000 items
2. View that playlist
3. Wait and wait

And...

1. Click a video from that playlist
2. Wait and wait and wait (takes as long as loading the playlist to leave the playlist)

And..

1. Watch a video in that playlist to the end
2. Wait and wait and wait
3. Next video plays

Expected Behavior

I've recently switched to a newer snapshot (v3847) and it has the new playlist system. Now my Favorites were converted to a playlist called Favorites. On the older version this single Playlist was displaying instantly, and now with the new system, every single video in the playlist seems to get processed. And I just expect the top most items showing up as fast as they used to. I also often switch between Subscription view and Playlist view and this waiting time just breaks my workflow, distracting me.

What's even worse is that if I want to watch a video by clicking on it from that playlist it again takes this huge amount of time until the Video view is loaded, the entire playlist gets processed again. And when I've finished watching one video loading the next also takes seconds. Making the entire thing the opposite of enjoyable to use.

Of course, I could just create a new Favorites playlist, but eventually I end up with hundreds of playlists. And maybe I want to keep those videos in that playlist so it's easier to find videos I have watched half a year or a year ago.

I wonder if those playlists are saved as a JSON file? Maybe it's time to switch to a database format?

Issue Labels

usability issue

FreeTube Version

v0.19.1-nightly-3847 Beta

Operating System Version

Windows 11 Pro, 23H2

Installation Method

.exe

Primary API used

Local API

Last Known Working FreeTube Version (If Any)

No response

Additional Information

No response

Nightly Build

• I have encountered this bug in the latest nightly build.

[efb4f5ff-1298-471a-8973-3d47447115dc]

Hi @Gorrrg when watching a video from your playlist do you experience high cpu usage during playback?

[Gorrrg]

Testing on built 5020: No high CPU usage during playback once FreeTube has fully loaded the watch page and the playlist on the side. Scrolling in that playlist on the side causes high CPU usage, although it only takes about 5 seconds to display the new position in the list. Nothing compared to 1-2 minutes of waiting while FreeTube is loading the playlist into memory after changing from the playlist page to the watch page. Yet the downer is that when you select a new video from the sidebar playlist it again takes minutes until the watch page is ready.