Robots.txt free download

You are here > Home : Internet

Robots.txt - A handy tool to track spider visits and create Robots.txt instructions

	Devoloper:	NetPromoter
	License:	Shareware
	Price($):	99.90
	OS:	Win98,WinME,WinNT 4.x,Windows2000,WinXP,Windows2003
	File Size(KB):	2870
	Version:	2.0
	Last Update:	2004-05-01
	Rating:
	Screenshot:	Preview
	Download Now
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with
Visit homepage of Robots.txt

Programs related to Robots.txt:

ActiveWeb Express - Web CMS offering advanced functions including WYSIWYG, workflow, versioning, etc

WebPosition Gold 2 - Search Engine Promotion Software

PHPWebQuiz - PHPWebQuiz is a program to solve quizzes online on the Internet/Intranet.

ezimerchant Professional - ezimerchant Professional e-commerce enabled shopping cart software.

Shopping Cart for PayPal - E-commerce and shopping cart software for PayPal

Metagate - Suchmaschinen-Anmeldung / Indexierung / Website-Optimierung

AdWords Clever Wizard - An extremely easy to use AdWords suggestion and research software.

ExpediteShip for DHL - DHL certified ActiveX Control for custom shipping solutions development

Also Try:

Internet/Site promotion	Internet/Site optimization	Internet/Search engine optimization
Internet/Web development	Internet/E-commerce	Internet/Log file analysis
Business/Web development	Business/E-commerce	Development tools/E-commerce