1 - RoboGen SE v1.53 is a visual editor for Web robot exclusion files that lets you create the ROBOTS.TXT files required to instruct search engines which parts of a Web site are not to be indexed and made searchable by the general public. License: Time-limited Trial OS: Windows 95/98/Me/NT/2000 Size: 730 KB