# Allow all robots to spider the domain User-agent: * Disallow:/*.exe$ Disallow:/*.gif$ Disallow:/*.jpg$ Disallow:/*.png$