multilanguage

Saturday, November 19, 2011

Dowload films from youtube (...and other similar)

Few years ago the download was a lot easier, you could copy the movie directly from the browser cache. So far as can be. It's just that search files on the disk is increasingly hindered. Why not just skip the browser  and download directly from server, communicate like browser? (Almost like MIDM) provide a method to download videos from youtube and the like, way fast enough and at first glance complicated, but always effective.

To download video from youtube besides the obvious access to the internet we need are two things:

  1. program called curl
  2. browser with the possibility to investigate the loading elements of page 
ad. 1) curl is exactly programming library that supports HTTP request and so... Something like simply console browser. For more information you should look here: http://en.wikipedia.org/wiki/CURL you can download it heae: http://curl.haxx.se/download.html (version for all! operation system).
ad 2)  So each for the tree: Google Chrome, Opera or Mozilla Firefox. By the way, if you use other, especially M$ I recommended to replace it.

Time to work, first we need  a target video, i will download: Josh Gabriel presents Winter Kills - Hot As Hades because i  want to use this video as mp3 (i forgot to add that is one of possibilities?).
We start the browser and enter the target page (as we can just want to see the movie). We select the video quality which we want to download. Now we click right mouse button anywhere on the page and select from menu: "Examine the element" or "Inspect Element", or something similar to that. The box should appear:

We enter the tab "Network" and reload the page when there is nothing. We have shown there: type, size and loading time of objects on the page. Now we come to a key moment, in this list we find our video, we are looking for something that: 
  • is a video file with mp4/flv extension
  • have large size (sometimes file load from cache, and it is not displayed)
  • on youtubie has a name: "videoplaback" but this may change
When we find something like this:
We click on this element to see a data which are send to download element:
Teraz musimy podszyć się pod przeglądarkę i ściągnąć film na nasz dysk. Wykorzystujemy user-agent przegladarki i nasze cookie (najczęściej na tej podstawie serwisy pamiętają nasze ustawienia i to, że jesteśmy zalogowani). Prawda, że pięknie? Korzystam z Linuxa toteż dla takiego systemu będzie dalszy opis, ktoś obeznany z komputerem raczej nie będzie miał problemów z przerobienie opisu pod swój system, w razie kłopotów służę pomocą w komentarzach. Z racji tego, że nagłówki potrafią być naprawdę długie utworzę plik z poleceniem który zostanie następnie uruchomiony z konsoli. Wszystko wygląda mniej więcej tak:
curl --cookie "podejrzane Cookie"
--user-agent "podejrzany user agent" 
"podejrzany Request URL" >> nazwa_pliku_do_ktorego_zapisujemy
Oczywiście jest to jedna linijka, "entery" zostały dodane tylko dla czytelności. Przykładowe polecenie wygląda tak (nie musi działa, bo cookie jest zmienione):
curl --cookie "__utma=27069237.1177215004.1298483923.1317044822.1317068786.41; 4a8c54416fbf0W2QAAABzCwAAAGJVMVZTN0VrdHU0cwsAAAAyTkxVZ3lUWVA3c3MLAAAAbDFWbkcyZlZ4bmtzCwAAAHRDRHJaM0dHaE5ncwsAAAB3YXlTLUNVOGJOc3MLAAAAV3EwaWRYWDMxODRzCwAAAE9XVGhYa2RxNFgwcwsAAABJSGo1eU9EYm53WXMLAAAAVWd5NXFBclgxRHNzCwAAAHYydXBXbHFkUEZBcwsAAABYbVBqOTZCcGhob3MLAAAAQzczdUU2VFZldWtzCwAAAEkxaDFzakkwTHA0cwsAAABNNmNZNm9tcHp2c3MLAAAAaGJCczA3dkZGbDBzCwAAAFZBd2JxNnY0cnJrcwsAAABYUEFjTDJvbE1pTXMLAAAAdWV6OEpiRTBmSElzCwAAAGVhelZ3LXNTUW4wcwsAAAByWjhWV1lsdUNFQXMLAAAAQWd4Q2NPTm1UYlVzCwAAAFM2bTdzTFpVY2xncwsAAAAzakdpLVZpNlVWd3MLAAAAbDZSdERiOTdrMU1zCwAAAEtQRVVkd1Vkd3ZjcwsAAABEdVdNZGdpcDhxMHMLAAAATVM3QmxUT3FlMzhzCwAAAHQ1U2xxNG5QMnZvcwsAAAB2RENfOWhhbTJiWXMLAAAAZkRwSURHTWZpYTBzCwAAAGNMN0Q5eGtTRzdRcwsAAABrTVRtclZTdVNyd3MLAAAAOHBoVDZPX0hjdXNzCwAAAG9JTWFrVXZuY3ZzcwsAAABDUkQ4QVVnMkFwRXMLAAAATFhPLWpLa3NRa01zCwAAADQ4dFV4SjJqTHZBcwsAAABMZUpuOU5VSlpTRXMLAAAAUVltLWRUMjRpUllzCwAAAHFOT0IwTDNLdFFBcwsAAABoR2ktT1NZRkVwc3MLAAAAVGRocTdqcHZSVFFzCwAAAEJjeDZVTDlnSXpjcwsAAABTbUZJWjdtTHhxNHMLAAAAN3BQRGU4MkV0N2NzCwAAAHlISk96X3k5clpFcwsAAABHVFJxeGZubllVUXMLAAAAVGRpaFRoSkZ5ejRzCwAAAEJKMlZLRjI3SjBrcwsAAABPa3p4eGF0aGRfRXMLAAAAbEYxSFltcUtxNGdzCwAAADA5VTRtLXFxSHlRcwsAAABON2pNamFUMW9Nb3MLAAAAVDFwTWh3b3llUzRzCwAAAFA2VFVET1M4TXBzcwsAAABpTkdPdmw1bVZGc3MLAAAASW9BQXR0UEF2SGNzCwAAAENwZGtVd0ExNThVcwsAAABvcW9IcDk3aGF0UXMLAAAAenAzaHpFb1NOX29zCwAuAAFNnZ21zM3llZDBjcwsAAABqd2llZWwwM2Mtd3MLAAAAeF9WNTdhYTFrQXNzCwAAAG14RGVFNEMzYlVBcwsAAAAxU0VsM0dFN1BhWXMLAAAATkNoOHZxdzAwRklzCwAAAHZQdXYyNkFFb2hjcwsAAABjaWRlcHJ3N05MOHMLAAAAbmtBTlZLcWVnWmtzCwAAAGJBS0NfMHFDR2pZcwsAAABTcnBzS2xwZnhxY3MLAAAAR2theUlJRi1icU1zCwAAAHRmcDVkWlZ2NjNJcwsAAAA2MUpfLXhCck9oMHMLAAAAZFlLbHJDZklCb2tzCwAAAHZNektscDItX2NncwsAAABtbEI1R3NmdEhEY3MLAAAAanlKTEd6alhHUDhzCwAAADlWa3dzSlhvd0JncwsAAABLRDN5VElYaWtHNHMLAAAAQlFlYVRnTDlhX2NzCwAAAHZvbFEzakx2NW5ncwsAAABYbjl2dVJPd21wUXMLAAAAVWl4NVNPa1hTbWNzCwAAAGhnMXdUZGJiMHhRcwsAAAB1ZzlJYU5tNzUtRXMLAAAAcWVDNTZETFB4UjRzCwAAAGxGWHUtYmpHM2lVcwsAAABZcktqdXJnTGNlNHMLAAAAZVBnSlJPUC1GaU1zCwAAAHhweUtxc29WVXRjcwsAAABQOFBRVVRpQk55d3MLAAAAVG1qck51dzEzcW9zCwAAAEJoY1pCcjM4S21jcwsAAAAzR0hGWDZyLVNUUXMLAAAARmNIdjBHZDA1V1lzCwAAAHNNMjU0YVpIZWdJcwsAAABIQ010cXBULXZRa3MLAAAANmlTYWhXcHNUbG9zCwAAAE5aSkYxSDlCcU53; wide=1; GEO=6bff22ea4efc9a62feef8f61f00491edcwsAAAAzUExR2xzTToN5Yw==; PREF=f1=50000000&fv=10.3.183&pvdm=0&fvdm=1&uvdm=1&plsf=time_updated&plso=" --user-agent "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/14.0.835.186 Safari/535.1" "http://o-o.preferred.netia-ktw1.v24.lscache1.c.youtube.com/videoplayback?sparams=id%2Cexpire%2Cip%2Cipbits%2Citag%2Cratebypass%2Ccp&itag=37&ip=81.0.0.0&signature=0F7E103A21D727AF0661A67602B9E6D607584096.4FF7043EB4E66DDA825E93039A1AB70705FE6551&sver=3&ratebypass=yes&expire=1317265200&key=yt1&ipbits=8&cp=U0hQTFJRU19FSkNOMF9KS1dDOm9ZSl8xNzlPWU1F&id=231818868afe3765&ptchn=armadamusic&ptk=armadamusic">>video2
Jak wspomniałem wcześniej cały ten kod zamieszczamy w jakimś pliku, u mnie będzie nazywał się youtube.sh, teraz dwie komendy w konsoli, chwila oczekiwania...
 ...i możemy obejrzeć już nasz film będąc offline:
Done! It is fast, isn't it? What next? We have several options, we can:
  •  convert film to other format (i recommended the program MEncoder), very good when we want to see a film on dvd player
  • use only audio as mp3, to do this we need SoundConverter (linux only) and/or audacity (all OS) (to cut unwanted parts and tagged the song).
The method should be effective on other services. I don't have to use other so i don't now...

No comments:

Post a Comment