Document howto export subscriptions from YouTube - #55

Gestas · 2021-04-17T16:28:24Z

Fixes #54.

jtagcat

I'd suggest breaking down the long list of steps to substeps, eg (add a tab to the beginning of sub-steps)

export foo foo
1. open link
2. foo bar
prepare file
import file

Using the link, you also have to re-number. jfyi you can just have everything as 1., and they will be automagically numbered.

Export-YouTube-subscriptions.md

jtagcat · 2021-04-17T23:26:16Z

Export-YouTube-subscriptions.md

-7. While logged into your Invidious account go to Subscriptions -> Manage Subscriptions -> 
-   Import/Export -> Import YouTube subscriptions, select the file you just downloaded and click on 
-   `Import`.
+**This process won't work if you go directly to [Google Takeout](https://takeout.google.com/). You must enter the Takeout process via YouTube as described below.**


Change language from won't, must to may, better.

Confirmed just now, I can do this just fine via takeout.google.com.

jtagcat · 2021-04-17T23:28:13Z

Export-YouTube-subscriptions.md

+11. Click "Create export"
+12. Wait for the export to complete, it should be fairly quick.
+13. Download the export, it will be a .zip file. 
+14. Expand the ZIP file. 


Add what you end up with (what to look for, what file to upload/import); a subscriptions.json file.

Export-YouTube-subscriptions.md

Co-authored-by: jtagcat <[email protected]>

SamantazFox · 2021-06-14T19:21:06Z

Can someone with a YT account check this?

jtagcat · 2021-06-15T09:22:35Z

I checked it on 2021-04-17, when I requested changes.

kuba-orlik · 2021-08-02T17:19:21Z

Those instructions don't work for me - the archive contains the subscriptions, but they are in csv, not json format, and Invidious can't parse it

SamantazFox · 2021-08-02T21:33:07Z

Those instructions don't work for me - the archive contains the subscriptions, but they are in csv, not json format, and Invidious can't parse it

Thanks for your feedback! Do you mind sharing some (anonymized) extracts of that data? I personally can't access Google accounts anymore, they're blocking me x)

Gestas · 2021-08-03T18:12:06Z

I can confirm Google has changed the format of the export from JSON to CSV. I'll work on a new process.

syeopite · 2021-08-03T18:23:08Z

Is the bug presented on #54 still even present? I'd expect Google to have resolved the issue by now

dhuschde · 2021-08-11T21:39:03Z

I haven't read the whole thread yet, but think, you need an example csv.
So here is mine (Language: German)
Abos.csv
Also, the Error in my Invidious Instance said something with K in Line one. If I change it to a J, it say's J, so it seems like Invie is able to read the file.

I host with YunoHost.

Logs
Title: Unexpected char 'K' at line 1, column 1 (JSON::ParseException)
Date: 2021-08-10T16:16:31Z
Route: /data_control?referer=%2Ffeed%2Fpopular
Version: 2021.07.27-5c76cdaa @ master

Backtrace

Unexpected char 'K' at line 1, column 1 (JSON::ParseException)
  from /usr/share/crystal/src/json/lexer.cr:371:7 in 'raise'
  from /usr/share/crystal/src/json/lexer.cr:367:5 in 'unexpected_char'
  from /usr/share/crystal/src/json/lexer.cr:366:11 in 'unexpected_char'
  from /usr/share/crystal/src/slice.cr:229:5 in 'next_token'
  from /usr/share/crystal/src/json/parser.cr:13:12 in '->'
  from lib/kemal/src/kemal/route.cr:12:9 in '->'
  from /usr/share/crystal/src/primitives.cr:255:3 in 'call'
  from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call'
  from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next'
  from lib/kemal/src/kemal/filter_handler.cr:21:7 in 'call'
  from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next'
  from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next'
  from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next'
  from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next'
  from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next'
  from src/invidious/helpers/static_file_handler.cr:112:11 in 'call'
  from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call'
  from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call'
  from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next'
  from lib/kemal/src/kemal/init_handler.cr:12:7 in 'process'
  from /usr/share/crystal/src/http/server.cr:498:5 in '->'
  from /usr/share/crystal/src/primitives.cr:255:3 in 'run'
  from ???

SamantazFox · 2021-08-11T22:27:19Z

I haven't read the whole thread yet, but think, you need an example csv.
So here is mine (Language: German)
Abos.csv

Thank you :)

I've heard that the data given by youtube is a zip archive. Is that right?
If yes, is that CSV the only file in it?

dhuschde · 2021-08-11T22:57:05Z

It gives you a ZIP. You can choose which files should be in there.
There will always be a “index” which tells you where which file is and then the files. So it's always different.

SamantazFox · 2021-08-12T21:38:19Z

It gives you a ZIP. You can choose which files should be in there.
There will always be a “index” which tells you where which file is and then the files. So it's always different.

Can you please provide that index file, too? because without it, We have no way to guess the subscriptions file name without it (especially in non-english locales)

dhuschde · 2021-08-13T10:56:36Z

Here is my whole ZIP file: takeout-20210810T160826Z-001.zip
It's in German again.
I also chose to only include the Subs.

PaulDance

A typo and a small grammatical mistake I think.

Export-YouTube-subscriptions.md

Co-authored-by: Paul Mabileau <[email protected]>

SamantazFox · 2021-08-25T21:13:35Z

Here is my whole ZIP file: takeout-20210810T160826Z-001.zip
It's in German again.
I also chose to only include the Subs.

Oh, thanks! Sorry, didn't see your message!

And that's annoying: they translate everything, even the file names.
As usual, this is a violation of the GDPR... (the "data portability" chapter explicitely say that the data should be easily parsable by a machine, which, indeed, isn't, as the data is not normalized to a single language)

SamantazFox · 2021-08-25T21:22:47Z

Export-YouTube-subscriptions.md

+**This process won't work if you go directly to [Google Takeout](https://takeout.google.com/). You must enter the Takeout process via YouTube as described below.**
+
+1. Make sure you are signed into YouTube with the account you want to export subscriptions from. 
+2. Open https://takeout.google.com/takeout/custom/youtube?continue=https%3A%2F%2Fmyaccount.google.com%2Fyourdata%2Fyoutube%3Fhl%3Det%26authuser%3D0


Suggested change

2. Open https://takeout.google.com/takeout/custom/youtube?continue=https%3A%2F%2Fmyaccount.google.com%2Fyourdata%2Fyoutube%3Fhl%3Det%26authuser%3D0

2. Open https://takeout.google.com/takeout/custom/youtube?continue=https%3A%2F%2Fmyaccount.google.com%2Fyourdata%2Fyoutube%3Fhl%3Den%26authuser%3D0

prefer hl=en, so the link may be in english (though I suspect that google doesn't take it into account and determines the language base on the IP address).

SamantazFox · 2021-08-25T21:24:13Z

Export-YouTube-subscriptions.md

+
+1. Make sure you are signed into YouTube with the account you want to export subscriptions from. 
+2. Open https://takeout.google.com/takeout/custom/youtube?continue=https%3A%2F%2Fmyaccount.google.com%2Fyourdata%2Fyoutube%3Fhl%3Det%26authuser%3D0
+6. Click `All YouTube data included`.


indexing is wrong.

unixfox · 2023-03-05T08:44:20Z

Is this still relevant?

Export subs from YouTube

b7a2950

jtagcat suggested changes Apr 17, 2021

View reviewed changes

TheFrenchGhosty and others added 4 commits May 26, 2021 18:41

Update Export-YouTube-subscriptions.md

1006570

Co-authored-by: jtagcat <[email protected]>

Update Export-YouTube-subscriptions.md

e203bcb

Co-authored-by: jtagcat <[email protected]>

Update Export-YouTube-subscriptions.md

c918563

Co-authored-by: jtagcat <[email protected]>

Update Export-YouTube-subscriptions.md

cad8d8d

Co-authored-by: jtagcat <[email protected]>

SamantazFox mentioned this pull request Aug 11, 2021

[Bug] Unexpected char 'C' at line 1 - Youtube is now serving csv file instead of json file when exporting the subscriptions iv-org/invidious#2319

Closed

PaulDance suggested changes Aug 23, 2021

View reviewed changes

Export-YouTube-subscriptions.md Outdated Show resolved Hide resolved

Export-YouTube-subscriptions.md Outdated Show resolved Hide resolved

Apply suggestions from PaulDance

f7da68f

Co-authored-by: Paul Mabileau <[email protected]>

SamantazFox reviewed Aug 25, 2021

View reviewed changes

TheFrenchGhosty added the unfinished label Oct 3, 2021

TheFrenchGhosty marked this pull request as draft October 3, 2021 17:07

0x24D mentioned this pull request Nov 15, 2021

Implement importing Youtube subscriptions from CSV iv-org/invidious#2621

Closed

SamantazFox mentioned this pull request Jan 28, 2022

It's csv now #188

Merged

unixfox closed this Nov 10, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Document howto export subscriptions from YouTube - #55

Document howto export subscriptions from YouTube - #55

Gestas commented Apr 17, 2021 •

edited by SamantazFox

Loading

jtagcat left a comment •

edited

Loading

jtagcat Apr 17, 2021

jtagcat Apr 17, 2021

SamantazFox commented Jun 14, 2021

jtagcat commented Jun 15, 2021

kuba-orlik commented Aug 2, 2021

SamantazFox commented Aug 2, 2021 •

edited

Loading

Gestas commented Aug 3, 2021

syeopite commented Aug 3, 2021

dhuschde commented Aug 11, 2021

SamantazFox commented Aug 11, 2021

dhuschde commented Aug 11, 2021

SamantazFox commented Aug 12, 2021

dhuschde commented Aug 13, 2021

PaulDance left a comment

SamantazFox commented Aug 25, 2021 •

edited

Loading

SamantazFox Aug 25, 2021

SamantazFox Aug 25, 2021

unixfox commented Mar 5, 2023

	2. Open https://takeout.google.com/takeout/custom/youtube?continue=https%3A%2F%2Fmyaccount.google.com%2Fyourdata%2Fyoutube%3Fhl%3Det%26authuser%3D0
	2. Open https://takeout.google.com/takeout/custom/youtube?continue=https%3A%2F%2Fmyaccount.google.com%2Fyourdata%2Fyoutube%3Fhl%3Den%26authuser%3D0

Document howto export subscriptions from YouTube - #55

Document howto export subscriptions from YouTube - #55

Conversation

Gestas commented Apr 17, 2021 • edited by SamantazFox Loading

jtagcat left a comment • edited Loading

Choose a reason for hiding this comment

jtagcat Apr 17, 2021

Choose a reason for hiding this comment

jtagcat Apr 17, 2021

Choose a reason for hiding this comment

SamantazFox commented Jun 14, 2021

jtagcat commented Jun 15, 2021

kuba-orlik commented Aug 2, 2021

SamantazFox commented Aug 2, 2021 • edited Loading

Gestas commented Aug 3, 2021

syeopite commented Aug 3, 2021

dhuschde commented Aug 11, 2021

SamantazFox commented Aug 11, 2021

dhuschde commented Aug 11, 2021

SamantazFox commented Aug 12, 2021

dhuschde commented Aug 13, 2021

PaulDance left a comment

Choose a reason for hiding this comment

SamantazFox commented Aug 25, 2021 • edited Loading

SamantazFox Aug 25, 2021

Choose a reason for hiding this comment

SamantazFox Aug 25, 2021

Choose a reason for hiding this comment

unixfox commented Mar 5, 2023

Gestas commented Apr 17, 2021 •

edited by SamantazFox

Loading

jtagcat left a comment •

edited

Loading

SamantazFox commented Aug 2, 2021 •

edited

Loading

SamantazFox commented Aug 25, 2021 •

edited

Loading