This is a python wrapper to provide a web interface to get_iplayer.
It provides
- a search tool for radio and tv programs
- a queuing process to allow sequential downloads
- a post-download trancoding function to make the media files useful on other devices
- an in-browser viewing/streaming page to watch and listen to media (this requires download the free JW Player/Longtail streamer)
- a favourites feature to remember specific "brands" and series
So for example, you can download a TV program, trancode it to mp4 and watch it right in the browser, much as you might use iplayer.
Or you might download a radio program, transcode to mp3 and download it onto your phone. Using the podcast tool you can automate this to make it really easy!
The queuing process uses the system cron function, so you can set it run when you bandwidth is cheaper, or when your network connection is less used.
All code and documents are licensed under the GPL version 3.
- install python2 - on ubuntu 16.04, python3 is installed by default, so
sudo apt-get install python
on OpenSuse, you need to install python-odict for ordered dictionaries:
sudo zypper install python-odict
- install an http server that supports
cgi-bin, e.g. apache2
apt-get install apache2
- how to enable traditional cgi-bin behaviour in apache/httpd server for Debian or Ubuntu:
cd /etc/apache2/mods-enabled/
sudo ln -s ../mods-available/cgi.load
sudo apachectl restart
- enable web access to the place where downloaded videos are put, e.g. to /home/iplayer this is done by editing the default apache vhost configuration, e.g. /etc/apache2/sites-available/000-default.conf and adding these lines:
Alias /iplayer "/home/iplayer"
<Directory "/home/iplayer">
Options FollowSymLinks Indexes
AllowOverride None
Allow From All
Require all granted
</Directory>
and then reloading the apache configuration with apache2ctl graceful
- download the get_iplayer program from
https://raw.githubusercontent.com/get-iplayer/get_iplayer/master/get_iplayerand put it into thecgi-bindirectory and make executable, and install perl and dependencies - on Debian or Ubuntu:
cd /usr/lib/cgi-bin/
sudo wget https://raw.githubusercontent.com/get-iplayer/get_iplayer/master/get_iplayer
sudo chmod ugo+x get_iplayer
sudo apt-get install libcgi-pm-perl libhtml-html5-entities-perl libhtml-entities-numbered-perl libhtml-html5-parser-perl
- (optional) get the JW Player if you wish to be able to play FLV videos embedded in the web page - see instructions in Playback.
- download the web_get_iplayer.py from
https://raw.githubusercontent.com/speculatrix/web_get_iplayer/master/web_get_iplayer.pyand put it into thecgi-bindirectory and make executable - on Debian or Ubuntu:
cd /usr/lib/cgi-bin/
sudo wget https://raw.githubusercontent.com/speculatrix/web_get_iplayer/master/web_get_iplayer.py
sudo chmod ugo+x web_get_iplayer.py
Access the web interface with your web browser, e.g. http://localhost/cgi-bin/web_get_iplayer.py
The program analyses its environment and will tell you what to do, e.g. what directories to create and what permissions to give them.
Note that if it doesn't run at all, run it at the command line as the httpd user id to check python has all the libraries it needs, like this:
sudo -i -u www-data /usr/lib/cgi-bin/get_iplayer
Set up cron so as to call the wrapper script.
- start a root shell
- change directory to the
cgi-bindirectory - get the wrapper script with this command:
wget https://raw.githubusercontent.com/speculatrix/web_get_iplayer/master/web_get_iplayer.cron.sh
- and make it executable
chmod ugo+x web_get_iplayer.cron.sh
- get the cron table file with
wget -O /etc/cron.d/web_get_iplayer https://raw.githubusercontent.com/speculatrix/web_get_iplayer/master/_etc_cron.d_web_get_iplayer
- tweak the
/etc/cron.d/web_get_iplayerif yourcgi-bindirectory is different - test it, on Debian/Ubuntu to check there are no errors:
sudo -i -u www-data /usr/lib/cgi-bin/web_get_iplayer.cron.sh
These together run the download queue. You could change the cron tab to run at night if your bandwidth is cheaper then, or change the frequency at which it runs if you want to allow your server to idle more.
In case of problems, check files in /var/lib/web_get_iplayer/ which is where
all the queues and logs are kept.
The Dockerfile included can be used to build a local version of the web_get_iplayer script on Debian Wheezy.
docker build -t {name} .
docker run -d --mount source={directory},target=/home/iplayer -p 10080:80 {name}
Where {name} is the name of the docker image you want to produce and {directory} is the destination for downloads. The server will be available on http://localhost:10080
Optionally, also mount /var/lib/web_get_iplayer to get access to the iplayer logs from outside the container.
For convenience, there is also a version of the script on Docker Hub:
docker pull cscashby/web_get_iplayer
docker run -d --mount source={directory},target=/home/iplayer -p 10080:80 cscashby/web_get_iplayer
Where {directory} is the destination for downloads. The server will be available on http://localhost:10080
Optionally, also mount /var/lib/web_get_iplayer to get access to the iplayer logs from outside the container.
Also optionally, if you have --pid-recursive in your get_iplayer settings, it's possible to schedule a job to enqueue a download on a nightly basis to catch up with your favourite programmes. You'll need the PID from the series (use the URL from the iplayer series page).
sudo docker run --init --name {NAME} -d -e "OPTIONS=http://{HOST IP}:10080/cgi-bin/web_get_iplayer.py?page=download&title=&subtitle=&pid={PID}&mediatype=videosubmit=enqueue" -e CRON_SCHEDULE="0 1 * * *" jsonfry/curl-cron:latest
(You can use a browser's development tools to get the URL from the Download page if you want to add other options such as Transcode)
NOTE: The above Docker image jsonfry/curl-cron is a third party image and may be subject to change, etc.
You should be able to play back the downloaded files with mplayer, vlc, ffplay etc.
If you want to play back video or audio tracks in the browser, you need JWPlayer, which can play FLV (flash video), mpeg4, mp3 or m4a (audio files).
You will need a key in order to use JWPlayer, so register at www.jwplayer.com
Usually, if you've registered correctly, the download page will be https://dashboard.jwplayer.com/#/welcome
Download the jwplayer-version.zip file, make a note of the licence key. Latest at: https://ssl.p.jwpcdn.com/player/download/jwplayer-7.12.8.zip Unpack the zip file into your htdocs directory, so it appears as http://example/jw-player-*version*/ and ensure the appropriate relative URI is put into the configuration (Flv7Uri) along with the licence key string.
cd /var/www/html/
sudo wget https://ssl.p.jwpcdn.com/player/download/jwplayer-7.12.8.zip
sudo unzip jwplayer-7.12.8.zip
You can transcode the TS (video) and M4A (audio) files into other formats to play on other devices; mp4 is a popular choice for video, mp3 for audio. The UI offers this possibility, whereby it calls a transcode command. Some useful scripts are provided for doing this, ts-to-mp4.sh and m4a-to-mp3.sh . Download them and make them executable. A good place to put them is /usr/local/bin, but you can configure their locations in the settings.
If you install the JWPlayer, then it can play .flv and .mp4 video files, but also luckily .m4a audio files, without them needing to be transcoded, which means you do everything in the browser.
In order to transcode, you need to install the ffmpeg tool. Note that on
openSuse you should install from the Packman repository because the default
openSuse version is missing the AAC codec. With Ubuntu, you may need to add
"-strict -2" to the ts-to-mp4.sh script in order to enable the AAC codec,
otherwise you'll see this error:
[aac @ 0xc16a40] The encoder 'aac' is experimental but experimental codecs are not enabled, add '-strict -2' if you want to use it.
- sometimes programs don't show up in search but do on http://www.bbc.co.uk/iplayer and you have to copy the program ID manually into the download function
- audio/radio search is imperfect at finding programs; reverse engineering the http API is not trivial, and is a work in progress
- all the downloaded audio and video files live in the same directory
- there's no feature to move files into sub-directories
- the program uses the same web/http API as the android app for searching
- simple json files are used for the queue files
- a cron job runs the queue
- the get_iplayer tool actually does the download, see https://github.com/get-iplayer/get_iplayer
- the program simply tabulates the files in the downloads directory
- Use
--pid-recursive-noclips --pid-recursiveat the end of thedownload_argssetting to allow for pids of series and programmes- this will download multiple files.
Perhaps the most convenient way to listen to downloaded radio shows is using a podcast player on a portable device.
There's three things you need to do this
-
genRSS.py The genRSS.py tool will create an RSS XML feed which should be compatible with most podcast players. This was forked so that it can handle multiple directories. Grab the forked copy here: https://raw.githubusercontent.com/speculatrix/genRSS/master/genRSS.py and put it at /usr/local/bin and make it executable
-
the wrapper script This wrapper script calls the genRSS.py script with a list of directories to be scanned. Grab a copy from https://raw.githubusercontent.com/speculatrix/web_get_iplayer/master/make_iplayer_radio_rss.sh and put it in /usr/local/bin and make it executable. You will almost definitely need to tweak it with your specific configuration.
-
a cron job add a cron job to update the RSS feed every so often, something along these lines:
# every two hours update the RSS feed of BBC iplayer radio downloads
5 */2 * * * /usr/local/bin/web_get_iplayer/make_iplayer_radio_rss.sh http://example.co.uk/iplayerFor more information about the get_iplayer tool, please visit https://forums.squarepenguin.co.uk/
For more information about the RSS XML podcast generator, please visit the forked project on github https://github.com/speculatrix/genRSS
This program wouldn't be possible with the awesome get_iplayer developers: https://github.com/get-iplayer
The podcast generator was originally written by Amine Sehili and the original code is at https://github.com/amsehili/genRSS