<?xml version="1.0"?>
<rss version="2.0">
	<channel>
		<title>Downloading large amounts of files</title>
		<link>http://www.allegro.cc/forums/view/593737</link>
		<description>Allegro.cc Forum Thread</description>
		<webMaster>matthew@allegro.cc (Matthew Leverton)</webMaster>
		<lastBuildDate>Tue, 23 Oct 2007 02:01:06 +0000</lastBuildDate>
	</channel>
	<item>
		<description><![CDATA[<div class="mockup v2"><p>So what I want to do is basically download a large amount of files from a website. Now, I don&#39;t really want to click on every link, so I&#39;m looking for a quick and easy way to do this.</p><p>I think wget is what I&#39;m looking for, but now I&#39;m not sure what language to write the script in to use it.</p><p>Basically I want to do this in a scripting language.
</p><div class="source-code snippet"><div class="inner"><pre>path <span class="k3">=</span> <span class="s">"website here"</span><span class="k2">;</span>
<span class="k1">for</span><span class="k2">(</span><span class="k1">int</span> <a href="http://www.delorie.com/djgpp/doc/libc/libc_470.html" target="_blank">index</a> <span class="k3">=</span> <span class="n">0</span><span class="k2">;</span> <a href="http://www.delorie.com/djgpp/doc/libc/libc_470.html" target="_blank">index</a> <span class="k3">&lt;</span> <span class="n">100</span><span class="k2">;</span> <a href="http://www.delorie.com/djgpp/doc/libc/libc_470.html" target="_blank">index</a><span class="k3">+</span><span class="k3">+</span><span class="k2">)</span>
<span class="k2">{</span>
  url <span class="k3">=</span> path <span class="k3">+</span> <a href="http://www.delorie.com/djgpp/doc/libc/libc_470.html" target="_blank">index</a><span class="k2">;</span>
  filename <span class="k3">=</span> <a href="http://www.delorie.com/djgpp/doc/libc/libc_470.html" target="_blank">index</a> <span class="k3">+</span>.<span class="s">"zip"</span><span class="k2">;</span>
  wget url filename
<span class="k2">}</span>
</pre></div></div><p>

I mean I&#39;m sure I could write this code in Java or C++ and have it to the above, but what I&#39;m looking for is a tool that is meant for these kind of tasks as I don&#39;t think it makes sense writing separate applications each and every time I want to create something similar. </p><p>I think that&#39;s basically what I want to do, so what scripting language and or tool would make this the easiest? Anything I can write the above in say 3-5 lines of code in notepad and then just execute from the command line?
</p></div>]]>
		</description>
		<author>no-reply@allegro.cc (Hard Rock)</author>
		<pubDate>Mon, 22 Oct 2007 23:13:16 +0000</pubDate>
	</item>
	<item>
		<description><![CDATA[<div class="mockup v2"><p>Something like <tt>wget -r -np -A .zip www.foo.bar/frotz/</tt> should do the trick. I think. I can&#39;t recall the exact syntax right now, but it&#39;s all in the <a href="http://www.gnu.org/software/wget/manual/">manual</a>.
</p></div>]]>
		</description>
		<author>no-reply@allegro.cc (gnolam)</author>
		<pubDate>Mon, 22 Oct 2007 23:18:34 +0000</pubDate>
	</item>
	<item>
		<description><![CDATA[<div class="mockup v2"><p><span class="source-code">FOR <span class="k3">/</span>L %i IN <span class="k2">(</span><span class="n">0</span>,<span class="n">1</span>,<span class="n">99</span><span class="k2">)</span> DO wget whatever options just %i where you want the number</span></p><p>edit4: fixx0red or maybe not.
</p></div>]]>
		</description>
		<author>no-reply@allegro.cc (jhuuskon)</author>
		<pubDate>Mon, 22 Oct 2007 23:22:02 +0000</pubDate>
	</item>
	<item>
		<description><![CDATA[<div class="mockup v2"><p>If there&#39;s a high language script, you could use that, provided you can run it in a command in the case of PHP</p><p>Above two works as well. (jhuuskon&#39;s is Windows only though)
</p></div>]]>
		</description>
		<author>no-reply@allegro.cc (MiquelFire)</author>
		<pubDate>Mon, 22 Oct 2007 23:46:54 +0000</pubDate>
	</item>
	<item>
		<description><![CDATA[<div class="mockup v2"><p>You can also create a list of files you want to download, and then pass it with -i to wget, if I recall correctly.
</p></div>]]>
		</description>
		<author>no-reply@allegro.cc (ReyBrujo)</author>
		<pubDate>Mon, 22 Oct 2007 23:48:08 +0000</pubDate>
	</item>
	<item>
		<description><![CDATA[<div class="mockup v2"><p><a href="http://www.allegro.cc/forums/thread/593226">http://www.allegro.cc/forums/thread/593226</a>
</p></div>]]>
		</description>
		<author>no-reply@allegro.cc (Matthew Leverton)</author>
		<pubDate>Tue, 23 Oct 2007 00:17:15 +0000</pubDate>
	</item>
	<item>
		<description><![CDATA[<div class="mockup v2"><p>Awesome, thanks all!
</p></div>]]>
		</description>
		<author>no-reply@allegro.cc (Hard Rock)</author>
		<pubDate>Tue, 23 Oct 2007 02:01:06 +0000</pubDate>
	</item>
</rss>
