hi experts, using a robot.txt on a site. Will it help to increase the web traffic? or what are your thoughts and suggestion on this?
any inputs is greatly appreciated. :)
Thank you.
Printable View
hi experts, using a robot.txt on a site. Will it help to increase the web traffic? or what are your thoughts and suggestion on this?
any inputs is greatly appreciated. :)
Thank you.
robots.txt doesn't help you get traffic; it tells bots (search engines, most of the time) which pages/directories should be ignored. I say should, because it's not mandatory for any bots to actually read your robots.txt file when crawling your website -- but all of the big search engines will obey the rules you make inside of the file.
You can also put pictures of robots and job postings in your robots.txt file.
thanks guys, SambaNeko the job posting is good..i'll ask our HR to do the same..hahah