Google SiteMap 生成工具 (PHP & ASP)

Google SiteMap简介:
Google推出的Sitemap,是对原来robots.txt的扩展,它使用XML格式来记录整个网站的信息并供Google读取,使搜索引擎能更快更全面的收录网站的内容。Sitemap的作用就好像为网站提供了整站的RSS,而Google就是这些RSS的订阅者,只要网站有更新就会自动通知Google。这样一来,搜索引擎的收录由被动的Pull变成了主动的Push,辛苦的Google爬虫们终于可以松一口气了。
不过就目前来说,Google Sitemap还不是一个能让每个站长都方便使用的东西。其要求的XML格式虽不是很复杂,但要手工制作还是需要费不少功夫。虽然Google提供了Sitemap自动生成器,但目前只有python语言的版本, 能用上的也是少数,这个在实践中是得到了证实的,我看了N天都是一头雾水。不过Google Sitemap是按照创作共用协议发布的,Sitemap生成器也是开源的,所以相关的工具也很快出现了,我在网上就曾找到针对L-BLOG(此工具你可以参阅本博客直接生成XML的Google SiteMap代码ASP 4 LBLOG版本一文)、O-BLOG、DVBBS自动生成Sitemap的工具,只要简单的修改,各位站长和Blogger们就可以方便的使用这项服务了。
简单点说,就是你以XML的格式向Google提交一个站点地图,以后google就会根据这个地图,阶段性地抓取该地图指出的页面。抱怨google收入页面太少的朋友不妨一试。
以下是我找到的两个版本(ASP和PHP版)的网站SiteMap.xml生成工具,我现在用的就是以下ASP版的,经过测试了,我网站缘聚杭州生成的SiteMap文件:http://www.coosuo.com/SiteMap.xml,而下面的PHP版的代码,由于不是很懂,都没有测试过,大家可以试试如有错误,只有敬请谅解了!

ASP版代码:

<%
Server.ScriptTimeout=50000
' sitemap_gen.asp
' A simple script to automatically produce sitemaps for a webserver, in the Google Sitemap Protocol (GSP)
' by Francesco Passantino
' www.iteam5.net/francesco/sitemap
' v0.2 released 5 june 2005 (Listing a directory tree recursively improvement)
'
' BSD 2.0 license,
' http://www.opensource.org/licenses/bsd-license.php
' 收集整理: 重庆森林@im286.com
' 部分修改:    独人向晚QQ19433114
session("server")="http://www.coosuo.com" '你的域名
vDir = "/" '制作SiteMap的目录,相对目录(相对于根目录而言)
set objfso = CreateObject("Scripting.FileSystemObject")
root = Server.MapPath(vDir)

'response.ContentType = "text/xml"
'response.write "<?xml version='1.0' encoding='UTF-8'?>"
'response.write "<urlset xmlns='http://www.google.com/schemas/sitemap/0.84'>"

str = "<?xml version='1.0' encoding='UTF-8'?>" & vbcrlf
str = str & "<urlset xmlns='http://www.google.com/schemas/sitemap/0.84'>" & vbcrlf

Set objFolder = objFSO.GetFolder(root)
'response.write getfilelink(objFolder.Path,objFolder.dateLastModified)
Set colFiles = objFolder.Files
For Each objFile In colFiles
    'response.write getfilelink(objFile.Path,objfile.dateLastModified)
    str = str & getfilelink(objFile.Path,objfile.dateLastModified) & vbcrlf
Next
ShowSubFolders(objFolder)

'response.write "</urlset>"
str = str & "</urlset>" & vbcrlf
set fso = nothing

Set objStream = Server.CreateObject("ADODB.Stream")
With objStream
    '.Type = adTypeText
    '.Mode = adModeReadWrite
    .Open
    .Charset = "utf-8"
    .Position = objStream.Size
    .WriteText=str
    .SaveToFile server.mappath("/sitemap.xml"),2 '生成的XML文件名
    .Close
End With

Set objStream = Nothing
If Not Err Then
    Response.Write("<script>alert('成功生成站点地图!');history.back();</script>")
    Response.End
End If

Sub ShowSubFolders(objFolder)
    Set colFolders = objFolder.SubFolders
    For Each objSubFolder In colFolders
        if folderpermission(objSubFolder.Path) then
            'response.write getfilelink(objSubFolder.Path,objSubFolder.dateLastModified)
            str = str & getfilelink(objSubFolder.Path,objSubFolder.dateLastModified) & vbcrlf
            Set colFiles = objSubFolder.Files
            For Each objFile In colFiles
                'response.write getfilelink(objFile.Path,objFile.dateLastModified)
                str = str & getfilelink(objFile.Path,objFile.dateLastModified) & vbcrlf
            Next
            ShowSubFolders(objSubFolder)
        end if
    Next
End Sub

Function getfilelink(file,datafile)
    file=replace(file,root,"",1,-1,1)
    file=replace(file,"\","/")
    If FileExtensionIsBad(file) then Exit Function
    if month(datafile)<10 then filedatem="0"
    if day(datafile)<10 then filedated="0"
    filedate=year(datafile)&"-"&filedatem&month(datafile)&"-"&filedated&day(datafile)
    getfilelink = "<url><loc>"&server.htmlencode(session("server")&file)&"</loc><lastmod>"&filedate&"</lastmod><changefreq>daily</changefreq><priority>1.0</priority></url>"
    Response.Flush
End Function

Function Folderpermission(pathName)
    '需要过滤的目录(不列在SiteMap里面)
    PathExclusion=Array("\blog","\temp","\_vti_cnf","_vti_pvt","_vti_log","cgi-bin","\admin","\edu")
    Folderpermission =True
    for each PathExcluded in PathExclusion
        if instr(ucase(pathName),ucase(PathExcluded))>0 then
            Folderpermission = False
            exit for
        end if
    next
End Function

Function FileExtensionIsBad(sFileName)
    Dim sFileExtension, bFileExtensionIsValid, sFileExt
    'modify for your file extension (http://www.googleguide.com/file_type.html)
    Extensions = Array("asp","png","jpeg","zip","pdf","ps","html","htm","php","wk1","wk2","wk3","wk4","wk5","wki","wks","wku","lwp","mw","xls","ppt","doc","wks","wps","wdb","wri","rtf","ans","txt")
    '设置列表的文件名,扩展名不在其中的话SiteMap则不会收录该扩展名的文件

    if len(trim(sFileName)) = 0 then
        FileExtensionIsBad = true
        Exit Function
    end if

    sFileExtension = right(sFileName, len(sFileName) – instrrev(sFileName, "."))
    bFileExtensionIsValid = false 'assume extension is bad
    for each sFileExt in extensions
        if ucase(sFileExt) = ucase(sFileExtension) then
            bFileExtensionIsValid = True
            exit for
        end if
    next
    FileExtensionIsBad = not bFileExtensionIsValid
End Function
%>

PHP版代码:

<?php
/**
 * @author Tobias Kluge, enarion.net
 * @version 0.2, 2005-06-05 17:40 PT
 * @status working
 * @update Aditya Naik, so1o@so1o.net
 * @Licence: LGPL
 * 
 * editor: MildSeven@im286.com
 */

header('Content-type: application/xml; charset="GB2312"',true);

$website = "http://my.xxxxx.com"; /* change this */
$page_root = "/usr/local/psa/home/vhosts/subdomains/my/httpdocs"; /* change this */

/* maybe change this: */
$changefreq = "weekly"; //"always", "hourly", "daily", "weekly", "monthly", "yearly" and "never".
$priority = 0.8;
/* this sets the last modification date of all pages to the current date */
$last_modification = date("Y-m-d\TH:i:s") . substr(date("O"),0,3) . ":" . substr(date("O"),3);

/* list of allowed directories */
$allow_dir[] = "web";

/* list of disallowed directories */
$disallow_dir[] = "admin";
$disallow_dir[] = "_notes";

/* list of disallowed file types */
$disallow_file[] = ".inc";
$disallow_file[] = ".old";
$disallow_file[] = ".save";
$disallow_file[] = ".txt";
$disallow_file[] = ".js";
$disallow_file[] = "~";
$disallow_file[] = ".LCK";
$disallow_file[] = ".zip";
$disallow_file[] = ".ZIP";
$disallow_file[] = ".CSV";
$disallow_file[] = ".csv";
$disallow_file[] = ".css";
$disallow_file[] = ".class";
$disallow_file[] = ".jar";
$disallow_file[] = ".mno";
$disallow_file[] = ".bak";
$disallow_file[] = ".lck";
$disallow_file[] = ".BAK";

/* simple compare function: equals */
function ar_contains($key, $array) {
    foreach ($array as $val) {
        if ($key == $val) {
            return true;
        }
    }
    return false;
}

/* better compare function: contains */
function fl_contains($key, $array) {
    foreach ($array as $val) {
        $pos = strpos($key, $val);
        if ($pos === FALSE) continue;
        return true;
    }
    return false;
}

/* this function changes a substring($old_offset) of each array element to $offset */
function changeOffset($array, $old_offset, $offset) {
    $res = array();
    foreach ($array as $val) {
        $res[] = str_replace($old_offset, $offset, $val);
    }
    return $res;
}

/* this walks recursivly through all directories starting at page_root and
adds all files that fits the filter criterias */
// taken from Lasse Dalegaard, http://php.net/opendir
function getFiles($directory, $directory_orig = "", $directory_offset="") {
    global $disallow_dir, $disallow_file, $allow_dir;

    if ($directory_orig == "") $directory_orig = $directory;

    if($dir = opendir($directory)) {
        // Create an array for all files found
        $tmp = Array();

        // Add the files
        while($file = readdir($dir)) {
            // Make sure the file exists
            if($file != "." && $file != ".." && $file[0] != '.' ) {
                // If it's a directiry, list all files within it
                //echo "point1<br>";
                if(is_dir($directory . "/" . $file)) {
                    //echo "point2<br>";
                    $disallowed_abs = fl_contains($directory."/".$file, $disallow_dir); // handle directories with pathes
                    $disallowed = ar_contains($file, $disallow_dir); // handle directories only without pathes
                    $allowed_abs = fl_contains($directory."/".$file, $allow_dir);
                    $allowed = ar_contains($file, $allow_dir);
                    if ($disallowed || $disallowed_abs) continue;
                    if ($allowed_abs || $allowed){
                        $tmp2 = changeOffset(getFiles($directory . "/" . $file, $directory_orig, $directory_offset), $directory_orig, $directory_offset);
                        if(is_array($tmp2)) {
                            $tmp = array_merge($tmp, $tmp2);
                        }
                    }
                } else { // files
                    if (fl_contains($file, $disallow_file)) continue;
                    array_push($tmp, str_replace($directory_orig, $directory_offset, $directory."/".$file));
                }
            }
        }

        // Finish off the function
        closedir($dir);
        return $tmp;
    }
}

$a = getFiles($page_root);
echo '<?xml version="1.0" encoding="UTF-8"?>';
?>
<urlset xmlns="http://www.google.com/schemas/sitemap/0.84">
<?php
foreach ($a as $file) :
?>
<url>
<loc><?php echo utf8_encode($website.$file); ?></loc>
<lastmod><?php echo utf8_encode(date("Y-m-d\TH:i:s", filectime($page_root.$file)). substr(date("O"),0,3) . ":" . substr(date("O"),3));?></lastmod>
<changefreq><?php echo utf8_encode($changefreq); ?></changefreq>
<priority><?php echo utf8_encode($priority); ?></priority>
</url>
<?php
endforeach;
?>
</urlset>

参数说明:
$website–你的域名
$page_root–你的站点的绝对路径
$changefreq–更新时间单位 "always"(始终), "hourly"(小时), "daily"(天), "weekly"(星期), "monthly"(月), "yearly" "never"(从不)
$priority–更新频率
$allow_dir–允许列表的目录
$disallow_dir–禁止列表的目录
$disallow_file–禁止列表的文件类型

制作过程说明:
  将以上代码复制到本地存为sitemap.asp或sitemap.php,上传到你的服务器网站的根目录下,运行一下就可以在你指定的目录中(建议最好是指定为根目录)自动生成一个sitemap.xml文件了。最后进入google提交页面:https://www.google.com/webmasters/sitemaps/login,有gmail的可以用gmail直接登录。登录后把生成的xml文件地址按步骤提交就可以了。注:你的网站如果增加了新的页面,可以在增加完后再运行一下sitemap.asp或sitemap.php,并再重新提交一下sitemap.xml文件,这样就可以保证sitemap.xml文件的不断更新了!

相关网址:
Google SiteMap官方生成器及其说明:http://sourceforge.net/project/showfiles.php?group_id=137793&package_id=153422
Google 的相关探索与研究:http://www.netbei.com/Article/zz/zz6/google/Index.html
一种手动制作分析制作SiteMap方法:http://blog.blogchina.com/hooligan/3609116.html
另一个PHP版的sitemap生成程序:
点击下载
运行界面:
==================================================================
自动生成符合GOOGLE要求的网站地图文件
Copyright Top flood
原作者 :
Kloh : TimeSplitters' Games; ImmortalPC :Immortal-PC

Laozei汉化整理 – IP查询、手机地理位置查询、身份证查询

注:
1.请把本程序放入网站根目录执行
2.程序执行前请修改如下参数(或常量)以符合你网站要求:
LIMITLIENPARFICHIER
LIMITLIENINDEXE
$ExtensionsAutorises
$DossiersInterdits
$FichiersInterdits
3.程序将把列表写入多个xml文件(如果你网页比较多的话)
4.sitemap(x).xml文件将写入根目录
URL列表(将写入sitemap)中。。。
./feed.php
./index.php
./error.php
./guestbook.php
./read.php
./tag.php
./tb.php
./view.php
./visit.php
9 行网址将被写入sitemap文件.
sitemap.xml文件生成完毕…
生成文件 sitemap.xml
全部生成完毕

发表评论