Crawl delay on all websites

[sahostking]

Hi guys

How can we add the following to all existing robots.txt and for any new domains added have a robots.txt file with the following in it.

User-agent: *
Crawl-delay: 300

Thanks

 

[zEitEr]

Hello,

Use a script PHP/BASH/PERL to go through all the files and update them with your content.

In bash I would rather run:

find /home/*/domains/*/public_html -name .htaccess -maxdepth 1

the code-line lists all .htaccess files on the top level of public_html. The code does not change anything yet.