WebAIM - Web Accessibility In Mind

E-mail List Archives

Re: CSS spiders

for

From: Steve Green
Date: Jul 9, 2013 7:05PM

You could do this with Xenu's Link Sleuth - http://home.snafu.de/tilman/xenulink.html - although it won't give you the results in the format you want so you would have to do a bit of work.

Xwnu is a website mapping tool that we use on virtually every project. Whilst the concept of mapping or spidering sounds simple there can often be a lot more to it than you would imagine. You often need to add subdomains and http/https variants or exclude certain parts of the website such as forums because they are too large. Occasionally you get badly-built websites that contain recursive URLs so the website appears to have an infinite number of pages.

After mapping the website you will have a list of all the files Xenu has found. Sorting by the MIME type will group the CSS files together. You can then view the Properties for each CSS file in turn, and Xenu will show you which pages link to them. You can copy these lists of pages into a spreadsheet where they can be manipulated more easily.

If anyone has any difficulty using Xenu please contact me off-list and I would be happy to help.



Steve Green
Test Partners Ltd