用正则表达式自动下载网页中的图片
2010-11-03 16:39
417 查看
原文网址:http://blog.csdn.net/yizhiduxiu11/archive/2010/09/13/5881442.aspx
首先获得网页的Html代码,然后用正则表达式分析其中图片的下载地址,最后自动逐个下载。
Code
using System.Net;
/**///// <summary>
/// Download Image from website
/// better to put into threads
/// </summary>
private void DownloadImage()
{
WebClient c = new WebClient();
//Get html code
string content = c.DownloadString(Uri);
Collection<string> address = new Collection<string>();
Collection<string> name = new Collection<string>();
//Analyse html code to get images address(Uri) and (Name) list
ParseHtml(content, Prefix, PicUriPrefix + @"(?<Uri>[^""]*?)"">(?<Name>[^<]*?)</dt>", address, name);
if (address.Count > 0 && name.Count > 0 && address.Count == name.Count)
{
if (Directory.Exists(folder) == false) Directory.CreateDirectory(folder);//Create folder
foreach (string add in address)
{
//Download images one by one
c.DownloadFile(add, Path.Combine(folder, name[address.IndexOf(add)] + ".jpg"));
}
}
}
/**//// <summary>
/// Parse Html using regular expressions
/// </summary>
/// <param name="content">Html content</param>
/// <param name="prefix">Uri prefix</param>
/// <param name="expression">regular expression</param>
/// <param name="address">Image addresses collection</param>
/// <param name="name">Image names collection</param>
private void ParseHtml(string content, string prefix, string expression, Collection<string> address, Collection<string> name)
{
if (String.IsNullOrEmpty(expression) || address == null || name == null) return;
Regex re = new Regex(expression, RegexOptions.IgnoreCase | RegexOptions.Singleline | RegexOptions.RightToLeft);
MatchCollection mc = re.Matches(content);
if (mc == null || mc.Count == 0) return;
foreach (Match m in mc)
{
address.Add(prefix + m.Groups["Uri"].Value);
name.Add(m.Groups["Name"].Value);
}
}
Html部分代码如下:
Html code
alt="" src="/docfile/dyn/12345678LANGCCCCDDDDEEEEEEEERT09">BMW 3-series</dt>/par
alt="" src="/docfile/dyn/12345678LANGCCCCDDDDEEEEEEEEEE01">Toyota</dt>/par
alt="" src="/docfile/dyn/12345678LANGCCCCDDDDEEEEEEEEJY25">Polo cross</dt>/par
alt="" src="/docfile/dyn/12345678LANGCCCCDDDDEEEEEEEEMO02">Golf 4.5</dt>/par
要用正则表达式从中获得图片下载地址(例如:/docfile/dyn/12345678LANGCCCCDDDDEEEEEEEERT09)和图片名称(例如:BMW 3-series)
正则表达式部分如下:
Regular expression
@"/docfile/dyn/(?<Uri>[^""]*?)"">(?<Name>[^<]*?)</dt>"
注意其中group的用法(? *?),和引号的匹配用法,匹配双引号前面需要再带一个双引号。其中Uri这个group在dyn/后面,直到双引号结束;后面跟随着双引号和>,然后就是Name这个group;它以<号结束,最后跟随</dt>。
本文来自CSDN博客,转载请标明出处:http://blog.csdn.net/yizhiduxiu11/archive/2010/09/13/5881442.aspx
首先获得网页的Html代码,然后用正则表达式分析其中图片的下载地址,最后自动逐个下载。
Code
using System.Net;
/**///// <summary>
/// Download Image from website
/// better to put into threads
/// </summary>
private void DownloadImage()
{
WebClient c = new WebClient();
//Get html code
string content = c.DownloadString(Uri);
Collection<string> address = new Collection<string>();
Collection<string> name = new Collection<string>();
//Analyse html code to get images address(Uri) and (Name) list
ParseHtml(content, Prefix, PicUriPrefix + @"(?<Uri>[^""]*?)"">(?<Name>[^<]*?)</dt>", address, name);
if (address.Count > 0 && name.Count > 0 && address.Count == name.Count)
{
if (Directory.Exists(folder) == false) Directory.CreateDirectory(folder);//Create folder
foreach (string add in address)
{
//Download images one by one
c.DownloadFile(add, Path.Combine(folder, name[address.IndexOf(add)] + ".jpg"));
}
}
}
/**//// <summary>
/// Parse Html using regular expressions
/// </summary>
/// <param name="content">Html content</param>
/// <param name="prefix">Uri prefix</param>
/// <param name="expression">regular expression</param>
/// <param name="address">Image addresses collection</param>
/// <param name="name">Image names collection</param>
private void ParseHtml(string content, string prefix, string expression, Collection<string> address, Collection<string> name)
{
if (String.IsNullOrEmpty(expression) || address == null || name == null) return;
Regex re = new Regex(expression, RegexOptions.IgnoreCase | RegexOptions.Singleline | RegexOptions.RightToLeft);
MatchCollection mc = re.Matches(content);
if (mc == null || mc.Count == 0) return;
foreach (Match m in mc)
{
address.Add(prefix + m.Groups["Uri"].Value);
name.Add(m.Groups["Name"].Value);
}
}
Html部分代码如下:
Html code
alt="" src="/docfile/dyn/12345678LANGCCCCDDDDEEEEEEEERT09">BMW 3-series</dt>/par
alt="" src="/docfile/dyn/12345678LANGCCCCDDDDEEEEEEEEEE01">Toyota</dt>/par
alt="" src="/docfile/dyn/12345678LANGCCCCDDDDEEEEEEEEJY25">Polo cross</dt>/par
alt="" src="/docfile/dyn/12345678LANGCCCCDDDDEEEEEEEEMO02">Golf 4.5</dt>/par
要用正则表达式从中获得图片下载地址(例如:/docfile/dyn/12345678LANGCCCCDDDDEEEEEEEERT09)和图片名称(例如:BMW 3-series)
正则表达式部分如下:
Regular expression
@"/docfile/dyn/(?<Uri>[^""]*?)"">(?<Name>[^<]*?)</dt>"
注意其中group的用法(? *?),和引号的匹配用法,匹配双引号前面需要再带一个双引号。其中Uri这个group在dyn/后面,直到双引号结束;后面跟随着双引号和>,然后就是Name这个group;它以<号结束,最后跟随</dt>。
本文来自CSDN博客,转载请标明出处:http://blog.csdn.net/yizhiduxiu11/archive/2010/09/13/5881442.aspx
相关文章推荐
- 用正则表达式自动下载网页中的图片
- 用正则表达式自动下载网页中的图片
- C#控制台基础 正则表达式,regex,webclient下载博客园网页中的一张图片
- Python中运用正则表达式抓取网页图片
- JAVA抓取网页的图片,JAVA利用正则表达式抓取网站图片
- asp.net正则表达式提取网页网址、标题、图片实例以及过滤所有HTML标签实例
- Java中使用正则表达式获取网页中所有图片的路径
- Java中使用正则表达式获取网页中所有图片的路径
- 正则表达式匹配网页中的图片地址
- PHP通过正则表达式获取网页中的所有图片
- PHP通过正则表达式下载图片到本地的实现代码
- 正则表达式,抓取网页所有图片
- swift 获取网页中图片地址的正则表达式
- 下载图片-使用正则表达式
- 最完美的匹配网页中图片 src 部分的正则表达式
- 用正则表达式采集网页上的图片信息
- C#通过正则表达式实现提取网页中的图片
- 正则表达式——抓取网页中的http及网络图片
- C# 正则表达式抓取网页上某个标签的内容,并替换链接地址和图片地址
- asp.net正则表达式提取网页网址、标题、图片实例以及过滤所有HTML标签实例