Repository files navigation

GitHub is no longer a place where I want to upload and share my code, for different reasons. I therefore decided to move my repositories to Codeberg, you can find this migrated repository here:

https://codeberg.org/Quasolaris/NewPipePlaylistExtractor

I will leave the repositories as they are for now on GitHub. Later this year I will archive them.

This Python script extracts playlists made with theNewPipe app and allows you to download them as audio-files.

When you create a playlist in NewPipe it is not saved as a YouTube playlist and can therefore not be downloaded via a playlist-link. This script allows you to extract the list of videos you have in a playlist and download them as audio files.

Buy Me A Coffee!

Stargazers over time

1. Features
2. Codecs
3. Dependencies
4. Usage
5. Linux
6. Windows
7. Android
8. GUI
9. Errors and Troubleshooting

• Download all playlists with chosen audio codec
• Downloads single playlist with chosen audio codec
• Export playlists as CSV file
• Export playlists as a TXT file (Format: "Playlist title" \n "URLs")
• Export playlists as a Markdown file
• Export playlists as a M3U8 file
• Output is coloured (Because colours are fun!)

The script supports the following codecs:

• mp3
• wav
• flac
• acc
• opus
• mp4

• pytubefixpip3 install pytubefix
• db-sqlite3pip3 install db-sqlite3
• pydubpip3 install pydub
• ffmpegsudo apt install ffmpeg
• The codec you want to download has to be installed on your machine

• Export your NewPipe data (Click here to see how)
• Load it to your PC
• Optionally, extract the newpipe.db file from it
• Run script with path to the NewPipe data ZIP file (python3 main.py NewPipe_<timestamp>.zip) or the extracted newpipe.db file (python3 main.py newpipe.db)
• Choose action
• Follow instructions
• To update playlists just repeat with new .db or .zip file. Already downloaded files will be ignored
• Enjoy your music!

The playlists get saved into the /Script/Playlists folder

Install the dependencies and you are good to go.

To use the script on Windows you have to do a few extra steps:

• Downloadffmpeg for Windows
• Unpack the archive
• Copy all .exe files from /ARCHIVE_NAME/bin
• Paste them inside the /Scripts folder
• Run script

For a step-by-step installation guide for Androidclick here.

To test the GUI that is in development, checkout thegui branch and runpython3 main_gui.py.

• Upload of DB ZIP file, path via CLI is no longer needed
• Selection of multiple songs playlists to donwload, instead of just one
• Simple Select All button if every playlist should be downloaded
• Track count of playlists are shown
• List is searchable

This is an error due to YouTube changing stuff, either to update or simply to attack Pytube, NewPipe and other clients/downloaders.

If no update was published or the error still persists, follow these steps:

1. Go to the pytube package folder (normally: ~/.local/lib/python3.9/site-packages/pytube or usepip list -v to find it if that doesn't work)
2. Open the cipher.py file in an editor of your choice (nano -c cipher.py the -c flag displays the line number where your cursor is)
3. Comment out the following lines: 272 and 273
4. Paste the following regex beneath the lines you just commented out (Make sure the white spaces are correct, it is Python after all):

r'a\.[a-zA-Z]\s*&&\s*\([a-z]\s*=\s*a\.get\("n"\)\)\s*&&.*?\|\|\s*([a-z]+)',r'\([a-z]\s*=\s*([a-zA-Z0-9$]+)(\[\d+\])\([a-z]\)',

5. Now go to line 290 (or 288 if you deleted the regex lines instead of commenting them out) with CTRL+_ in nano you can jump to a specific line.
6. Comment the following line out:

nfunc=function_match.group(1)),

7. Right underneath the now commented out line, place the following:

nfunc=re.escape(function_match.group(1))),

The file sector you changed should now look like this:

function_patterns= [# https://github.com/ytdl-org/youtube-dl/issues/29326#issuecomment-865985377# https://github.com/yt-dlp/yt-dlp/commit/48416bc4a8f1d5ff07d5977659cb8ece7640dcd8# var Bpa = [iha];# ...# a.C && (b = a.get("n")) && (b = Bpa[0](b), a.set("n", b),# Bpa.length || iha("")) }};# In the above case, `iha` is the relevant function name#r'a\.[a-zA-Z]\s*&&\s*\([a-z]\s*=\s*a\.get\("n"\)\)\s*&&\s*'#r'\([a-z]\s*=\s*([a-zA-Z0-9$]{3})(\[\d+\])?\([a-z]\)',r'a\.[a-zA-Z]\s*&&\s*\([a-z]\s*=\s*a\.get\("n"\)\)\s*&&.*?\|\|\s*([a-z]+)',r'\([a-z]\s*=\s*([a-zA-Z0-9$]+)(\[\d+\])\([a-z]\)',    ]logger.debug('Finding throttling function name')forpatterninfunction_patterns:regex=re.compile(pattern)function_match=regex.search(js)iffunction_match:logger.debug("finished regex search, matched: %s",pattern)iflen(function_match.groups())==1:returnfunction_match.group(1)idx=function_match.group(2)ifidx:idx=idx.strip("[]")array=re.search(r'var {nfunc}\s*=\s*(\[.+?\]);'.format(#nfunc=function_match.group(1)),nfunc=re.escape(function_match.group(1))),js                )ifarray:array=array.group(1).strip("[]").split(",")array= [x.strip()forxinarray]returnarray[int(idx)]raiseRegexMatchError(caller="get_throttling_function_name",pattern="multiple"

8. Save and close the file
9. You should now be able to download your playlists again

This is an error due to YouTube changing stuff, either to update or simply to attack Pytube, NewPipe and other clients/downloader. Seepytube/pytube#1499 (comment) for the issue and the fix.

1. First: Check if Pytube has an update, maybe the Pytube team already fixed it. If no update was published or the error still persists, follow these steps:
2. Go to the pytube package folder (normally: ~/.local/lib/python3.9/site-packages/pytube or usepip list -v to find it if that doesn't work).
3. Modify {path to pip packages}/pytube/cipher.py:

        transform_plan_raw = find_object_from_startpoint(raw_code, match.span()[1] - 1)

to

        transform_plan_raw = js

4. Save the file.
5. Try again.