Sitemap Generator in PHP (also web crawler, and searchThis actual program is a search engine crawler as well. It’s reading every file and parsing out the words and creating a matrix of words and frequency. Just like Google it will create keyword densities. If this was coupled with the search engine we created you would have a fully function search engine and crawler.