版权声明:本文为博主原创文章,遵循 CC 4.0 BY-SA 版权协议,转载请附上原文出处链接和本声明。

https://www.kaggle.com/c/avito-context-ad-clicks/data

kaggle 上面链接的数据,直接用 wget 命令是下载不了的。

wget https://www.kaggle.com/c/avito-context-ad-clicks/data 命令会被拒绝。

http://askubuntu.com/questions/161778/how-do-i-use-wget-curl-to-download-from-a-site-i-am-logged-into 该博客上讲述了各种解决方案,其实最关键的还是要 cookie.txt.

解决方案用 curl 命令下载该文件。

chrome 可以生成 curl 命令:

步骤:

比如要下载:Userinfo.tsv 文件

https://img-blog.csdn.net/20151230101913851?watermark/2/text/aHR0cDovL2Jsb2cuY3Nkbi5uZXQv/font/5a6L5L2T/fontsize/400/fill/I0JBQkFCMA==/dissolve/70/gravity/Center

第一步:到该下载按钮下,右键点击检查。切换到 Network 选项。

https://img-blog.csdn.net/20151230101948312?watermark/2/text/aHR0cDovL2Jsb2cuY3Nkbi5uZXQv/font/5a6L5L2T/fontsize/400/fill/I0JBQkFCMA==/dissolve/70/gravity/Center

第二步:点击该下载按钮,chrome 就会自动帮我们监控。

https://img-blog.csdn.net/20151230102047774?watermark/2/text/aHR0cDovL2Jsb2cuY3Nkbi5uZXQv/font/5a6L5L2T/fontsize/400/fill/I0JBQkFCMA==/dissolve/70/gravity/Center

出现了两个 UserInfo.tsv.7z

第三步:右键点击 Copyan cURL.(bash)

https://img-blog.csdn.net/20151230102117391?watermark/2/text/aHR0cDovL2Jsb2cuY3Nkbi5uZXQv/font/5a6L5L2T/fontsize/400/fill/I0JBQkFCMA==/dissolve/70/gravity/Center

然后将该命令复制到 ubuntu 上执行,就可以下载文件了

curl ‘https://kaggle2.blob.core.windows.net/competitions-data/kaggle/4438/UserInfo.tsv.7z?sv=2012-02-12&se=2015-12-10T16%3A26%3A05Z&sr=b&sp=r&sig=olOI7lwDgKKXFFYmpYXalphxKjFfDa5uQ5w7rIcMQGo%3D’-H ’Accept-Encoding: gzip, deflate, sdch’ -H ‘Accept-Language: zh-CN,zh;q=0.8’-H ‘Upgrade-Insecure-Requests: 1’ -H ‘User-Agent: Mozilla/5.0 (Windows NT 6.1;WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.2526.73Safari/537.36’ -H ‘Accept:text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,/;q=0.8’-H’Referer: https://www.kaggle.com/c/avito-context-ad-clicks/data‘-H’Connection: keep-alive’ –compressed

默认是输出到标准输出的